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(54) STORAGE DEVICE SYSTEM 
(57)Abstract 

PROBLEM TO BE SOLVED: To construct a storage device system 
corresponding to the scale or request of a computer system so 
that the extension of a storage device system and improvement in 
reliability in the future are easily realized. 

SOLUTION: This system 1 has a plurality of subsets 10 having a 
storage device for holding data and a controller for controlling the 
storage device and switch devices 20 arranged between the 
subsets 10 and a host 30. Each switch device 20 has a managing 
table for holding management information for managing the 
configuration of the storage device system 1. According to the 
management information, address information contained in frame 
information outputted by the host 30 is translated and the frame 
information is distributed to the subsets 10. 
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- CLAIMS 



[Claim(s)] 

[Claim 1] Two or more store subsystems which have the store which has a storage holding data, and the 
control device which controls this store, The configuration management table which was connected to the 
calculating machine which uses the data held at said two or more store subsystems, and stored store 
structure-o-Pa-system information, The 1st interface node which has a frame conversion means to change 
said frame based on the configuration information which answered the frame sent from said calculating 
machine, analyzed this frame, and was held at said configuration management table, Two or more 2nd 
interface nodes by which each was connected to any one of said the store subsystems, The storage 
system characterized by having a transfer means for said 1st interface node and said two or more 2nd 
interface nodes to be connected, and to transmit said frame between said 1st interface node and said two 
or more 2nd interface nodes. 

[Claim 2] It is the storage system according to claim 1 which said 1st interface node has a packet 
generation means to add and output the node address information on said 2nd interface node to said 
frame, and is characterized by said transfer means transmitting said frame based on said node address 
information between said 1st interface node and said two or more 2nd interface nodes. 
[Claim 3] It is the storage system according to claim 1 which said frame has a header unit holding the 
identifier which specifies the source and the destination, and the data stereo section holding the stereo 
data transmitted, and is characterized by said conversion means changing the identifier of the destination 
held at said header unit based on said configuration information. 

[Claim 4] Said conversion means is a storage process defined system according to claim 3 characterized 
by changing said 1st logical address information into the 2nd logical address managed within the store 
subsystem used as the destination of this frame based on said configuration information held at said 
configuration management table including tine 1st logical address information that said frame is recognized 
by said data stereo section by said computer. 

[Claim 5] Said storage system is a storage system according to claim 1 characterized by connecting with 
said transfer means, receiving the input of the configuration information which defines the storage 
structure of a system from an operator, answering this input further, and having the management processor 
which sets said configuration information as said configuration management table of each node. 
[Claim 6] Said configuration information is a storage process defined system according to claim 5 
characterized by including the information which restricts access to said two or more store subsystems 
from said calculating machine. 

[Claim 7] Said 1st interface node is a storage process defined system according to claim 2 characterized 
by to add node address information which is different on each frame, and to transmit to said transfer 
means so that the light command frame which directs the writing of the data transmitted from said 
calculating machine may be answered, those duplicates may be generated about the data frame following 
this light command frame and it and the data frame following said light command frame and it may be sent 
to at least two store subsystems. 

[Claim 8] Said 1st interface node is a store subsystem according to claim 7 characterized by adding node 
address information which is different in each lead command frame, and transmitting to said transfer means 
so that the lead command frame which directs the lead of the data transmitted from said calculating 
machine may be answered, the duplicate of this lead command frame may be generated and said lead 
command frame may be sent to said at least two store subsystems. 

[Claim 9] Said 1st interface node is a storage process defined system according to claim 8 characterized 
by receiving the data frame which answers said lead command frame and is transmitted from said at least 
two store subsystems, choosing one of these, and transmitting to said computer. 

[Claim 10] Said 1st interface node is a store subsystem according to claim 7 characterized by answering 
the lead command frame which directs the lead of the data transmitted from said calculating machine, 



adding the node address information on the 2nd interface node linked to the store subsystem of 1 
beforehand defined between said at least two store subsystems to said lead command frame, and 
transmitting to said transfer means. 

[Claim 1 1] Two or more store subsystems which have the store which has a storage holding data, and the 
control device which controls this store, The configuration management table which is switching equipment 
connected between the calculating machines using the data stored in said store, was connected to said 
calculating machine, and stored store structure-of-a-system information, A conversion means to change 
said frame based on said configuration information which answered the frame sent from said calculating 
^machine, analyzed this frame, and was held at said configuration management table, Two or more 2nd 
interface nodes by which each was connected to either of said store subsystems, Switching equipment by 
which it is having—transfer means for said 1st interface node and said two or more 2nd interface nodes to 
be connected, and to transmit said frame between said 1st interface node and said two or more 2nd 
interface nodes characterized. 
- [Claim 12] It is switching equipment according to claim 11 which has a packet generation means by which 
said 1st interface node adds and outputs the node address information on said 2nd interface node to said 
frame, and is characterized by said transfer means transmitting said frame based on said node address 
information between said 1st interface node and said two or more 2nd interface nodes. 
[Claim 13] It is switching equipment according to claim 11 which said frame has a header unit holding the 
identifier which specifies the source and the destination, and the data stereo section holding the stereo 
data transmitted, and is characterized by said conversion means changing the identifier of the destination 
held at said header unit based on said configuration information. 

[Claim 14] Said conversion means is switching equipment according to claim 13 characterized by changing 
said 1st logical address information into the 2nd logical address managed within the store subsystem used 
as the destination of this frame based on said configuration information held at said configuration 
management table including the 1st logical address information which shows the storing place of said data 
said frame is recognized to be by said data stereo section by said calculating machine. 
[Claim 15] Said switching equipment is switching equipment according to claim 11 characterized by 
connecting with said transfer means, receiving the input of the configuration information which defines the 
configuration of the storage process defined system which consists of operators including this switching 
equipment and said two or more store subsystems, answering this input further, and having the 
management processor which sets said configuration information as the configuration management table of 
each node. 

[Claim 16] Said 1st interface node is switching equipment according to claim 12 characterized by adding 
node address information which is different on each frame, and transmitting to said transfer means so that 
the light command frame which directs the writing of the data transmitted from said calculating machine 
may be answered, those duplicates may be generated about the data frame following this light command 
frame and it and the data frame following said light command frame and it may be sent to at least two 
store subsystems. 

[Claim 17] Said 1st interface node is switching equipment according to claim 16 characterized by adding 
node address information which is different in each lead command frame, and transmitting to said transfer 
means so that the lead command frame which directs the lead of the data transmitted from said calculating 
machine may be answered, the duplicate of this lead command frame may be generated and said lead 
command frame may be sent to said at least two store subsystems. 

[Claim 18] Said 1st interface node is switching equipment according to claim 17 characterized by receiving 
the data frame which answers said lead command frame and is transmitted from said at least two store 
subsystems, choosing one of these, and transmitting to said calculating machine. 
[Claim 19] Said 1st interface node is switching equipment according to claim 16 characterized by 
answering the lead command frame which directs the lead of the data transmitted from said calculating 
machine, adding the node address information on the 2nd interface node linked to the store subsystem of 1 
beforehand defined between said at least two store subsystems to said lead command frame, and 
transmitting to said transfer means. 

[Claim 20] Two or more store subsystems which have the store which has a storage holding data, and the 
control device which controls this store, The 1st interface node connected to the computer which uses the 
data held at said two or more store subsystems, Two or more 2nd interface nodes by which each was 
connected to any one of said the store subsystems, A transfer means for said 1st interface node and said 
two or more 2nd interface nodes to be connected, and to transmit a frame between said 1st interface node 
and said two or more 2nd interface nodes, The store system characterized by having the management 
processor which connects with said transfer means, is equipped with the managed table holding the 
configuration information which defines the store structure of a system inputted by the operator, and 
manages this store structure of a system based on said configuration information. 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach of improvement in the speed of a disk 
control system, low-cost-izing, and improvement in cost performance especially about the implementation 
approach of the disk control system which controls two or more disk units. 
[0002] 

[Description of the Prior Art] There is a disk array system which controls two or more disk units as a store 
system used for a computer system. About a disk array system, it is "A Case for Redundant Arrays of 
Inexpensive Disks" (RAID), for example.; It is indicated by InProc.ACM SIGMOD and June 1988 (University 
of California at Berkeley issue). A disk array is operating two or more disk units to juxtaposition, and is the 
technique of realizing improvement in the speed compared with the storage system which used the disk 
unit alone. 

[0003] There is an approach which used Fabric of a fiber channel (Fibre Channel) as an approach of 
connecting two or more disk array systems mutually with two or more hosts, the example of the computing 
system which applied this approach — Nikkei electronics 1995.7.3 (no.639) "Serial SCSI is to commercial 
scene still more" P.79 It is shown in drawing 3 . In the computing system indicated here, two or more host 
computers (below, it is only called a host) and two or more disk array systems are connected to fabric 
equipment through a fiber channel, respectively. Fabric equipment is the switch of a fiber channel and 
connects the transfer way between the equipment of the arbitration linked to fabric equipment Fabric 
equipment is transparency to a transfer of the "frame" which is the packet of a fiber channel, and a host 
and a disk array system communicate in two points, without being conscious of fabric equipment of each 
other. 
[0004] 

[Problem(s) to be Solved by the Invention] In the conventional disk array system, the number of a disk unit 
is increased for large— capacity-izing, and if it is going to realize the controller which has the engine 
performance which balanced the number for high-performance-izing, the performance limit of the internal 
bus of a controller and the performance limit of the processor which performs transfer control will 
actualize. In order to cope with such a problem, an internal bus is extended and increasing the number of 
processors is performed. However, the method of such management causes the complication of control 
software and the increment in an overhead by complication of a controller configuration, exclusive control 
of the share data of interprocessor, etc. by much bus control. For this reason, while raising cost very much, 
the engine performance is reaching the ceiling, consequently cost performance gets worse. Moreover, in a 
large-scale system, although such equipment can realize the engine performance corresponding to the 
cost, there is a technical problem which does not balance that the increase of a development cycle and the 
rise of development cost to which expandability is restricted are caused in the system whose scale is not 
so large. 

[0005] By putting two or more disk array systems in order, and interconnecting with fabric equipment, it is 
possible to perform large-capacity-izing as the whole system and high performance-ization. However, by 
this approach, since it cannot be distributed to other equipments even if it is irrelevant between disk array 
systems and access concentrates on a specific disk array system, high performance-ization on real use is 
unrealizable. Moreover, since the capacity of the logical disk unit (it is called Logical unit) seen from the 
host is restricted to the capacity of one set of a disk array system, large capacity-ization of Logical unit is 
unrealizable. 

[0006] Although the mirror configuration by two sets of disk array systems can be realized using the 
mirroring function which the host has when it is going to form the whole disk array system into high 
reliance, the control overhead for mirroring by the host occurs, and the technical problem that system 
performance is restricted occurs. Moreover, if many disk array systems exist according to an individual in a 



system, a load for a system administrator to manage will increase. For this reason, management cost 
Increases — many maintenance staffs and the maintenance costs for two or more sets are needed. 
Furthermore, since two or more disk array systems and fabric equipment are isolated systems, 
respectively, it is necessary to carry out various setup by different approach for every equipment. For this 
reason, employment cost increases with a manager's training and increase of an operate time. 
[0007] The purpose of this invention solves the technical problem in these conventional technique, can 
tuild the storage system according to the scale of a computing system, a demand, etc., and is to realize 
the storage system which can respond to the escape of the storage system in the future, improvement in 
dependability, etc. easily. 
[0008] 

- [Means for Solving the Problem] The store which has the storage with which the store system of this 
invention holds data, Two or more store subsystems which have the control device which controls this 
store, The 1st interface node connected to the computer which uses the data held at two or more store 
subsystems, Two or more 2nd interface nodes by which each was connected to either of the store 
subsystems, And the 1st interface node and two or more 2nd interface nodes are connected, and it has a 
transfer means to transmit a frame between the 1st interface node and two or more 2nd interface nodes. 
[0009] Preferably, the 1st interface node answers the frame sent from a calculating machine, analyzes this 
frame, carries out signal transduction to the configuration management table which stored store structure- 
of-a-system information about the destination of the frame based on the configuration information held at 
the configuration management table, and is transmitted to a transfer means. 

[0010] Moreover, on the occasion of a transfer of a frame, the 1st interface node adds the node address 
information on the node which should receive the frame to a frame. A transfer means transmits a frame 
according to the node address information added to the frame. The 2nd interface node carries out the 
reconstititution of the frame except for node address information from the frame received from the 
transfer means, and transmits it to the target store subsystem. 

[001 1] In a mode with this invention, a storage system has a management processor linked to a transfer 
means. A management processor sets configuration information as a configuration management table 
according to the directions from an operator. The information which restricts access from a computer is 
included in configuration information. 
[0012] 

[Embodiment of the Invention] [1st operation gestalt] drawing 1 is a block diagram in 1 operation gestalt of 
the computer system using the disk array system by which this invention was applied. 

[0013] It is the host computer (host) to which, as for 1, a disk array system is connected to, and, as for 30, 
a disk array system is connected. The disk array system 1 has the communication interface 80 between 
the disk array system-configuration-control means 70, and the disk array switch 20 and the disk array 
system-configuration-control means 70 of performing setting management of the disk array subset 10, the 
disk array switch 20, and the whole disk array system, and between the disk array subset 10 disk-array 
system— configuration-control means 70 (communication link I/F). It connects with the host interface (host 
I/F) 31, and a host 30 and the disk array system 1 connect host I/F31 to the disk array switch 20 of the 
disk array system 1. In the interior of the disk array system 1, the disk array switch 20 and the disk array 
subset 10 are connected with a disk array interface (disk array I/F21). 

[0014] Although a host 30 and four disk array subsets 10 are shown respectively, they are [ no limit ] 
about this number and are arbitrary by a diagram. The number of a host 30 and the disk array subset 10 
may differ. Moreover, the disk array switch 20 is doubled with this operation gestalt as illustration. Each 
host 30 and each disk array subset 10 are connected to the both sides of the disk array switch 20 doubled 
by respectively separate host I/F31 and disk array I/F21. This is for enabling access to the disk array 
system 1 from a host 30 by using another side, even if one disk array switch 20, host I/F31, or disk array 
I/F21 breaks down, and realizing high availability. However, such doubleness is not necessarily 
indispensable and is selectable according to the reliability level required of a system. 

[0015] Drawing 2 is the block diagram showing the example of 1 configuration of the disk array subset 10. 
The high order adapter which 101 interprets the command from host system (host 10), carries out a cache 
hit mistake judging, and controls the data transfer between host system and a cache, the shared memory 
(it is called a cache and a shared memory below) in which 102 stores the cache for disk data-access 
improvement in the speed and the share data between multiprocessors, and 104 are two or more disk units 
stored in the disk array subset 10. 103 is a low order adapter which controls a disk unit 104 and controls 
the data transfer between a disk unit 104 and a cache. 106 is a disk array subset configuration 
management means, communicates through the disk array system-configuration-control means 70 and 
communication link I/F80 which manage the disk array system 1 whole, and manages a setup of a 
configuration parameter, the report of fault information, etc. 



[0016] The high order adapter 101, a cache and a shared memory 102, and the low order adapter 103 are 
'doubled,, respectively. Like doubleness of the above-mentioned disk array switch 20, this reason is for 
realizing the sex for Takayoshi, and is not indispensable. Moreover, either of the doubled low order adapters 
103 of each disk unit 104 is also controllable. Although the same memory means is shared from a viewpoint 
of low-cost-izing to the cache and the shared memory with this operation gestalt, of course, these can 
also be dissociated. 

£0017] The high order adapter 101 includes the high order bus 1012 which performs communication link 
between a cache and a shared memory 102, and a high order MPU 1010 and the disk array l/F controller 
1011, and data transfer. [ the high order MPU 1010 which performs control of the high order adapter 101, 
host system 1011, i.e., the disk array I/F controller which controls disk array I/F21 which is connection I/F 
. with the disk array switch 20, and ] 

[0018] Although one disk array I/F controller 1011 is shown every high order adapter 101 by a diagram, two 
or more disk array I/F controllers 1011 may be formed to one high order adapter. 

[0019] The low order adapter 103 includes the low order bus 1032 which performs communication link 
between a cache and a shared memory 102, and the low order MPU 1030 and the disk I/F controller 1031 
which control disk I/F which is an interface with the low order MPU 1030 which performs control of the low 
order adapter 103, and a disk 104, and data transfer. [ the disk I/F controller 1031, and ] 
[0020] Although four disk l/F controllers 1031 are shown every low order adapter 103 by a diagram, the 
number is arbitrary and can be changed according to the configuration and the number of a disk to connect 
of a disk array. 

[0021] Drawing 3 is the block diagram showing the example of 1 configuration of the disk array switch 20. 
The management processor (MP) which is a processor to which 200 performs control and management of 
the whole disk array switch, the crossbar switch with which 201 constitutes the mutual switch path of nxn, 
the disk array I/F node in which 202 is prepared every disk array I/F21, the host I/F node in which 203 is 
prepared every host I/F31, and 204 are communication link controllers which perform the communication 
link between the disk array system-configuration-control means 70. I/F between clusters for the pass 
whose 2020 connects a crossbar switch 201 with the disk array I/F node 202, the pass on which 2030 
connects a crossbar switch 201 with the host I/F node 203, and 2040 to connect with other disk array 
switches 20, and constitute a cluster, and 2050 are the pass for connecting a crossbar switch 201 with 
MP200. 

[0022] Drawing 4 is the block diagram showing the structure of a crossbar switch 201. 2010 is a switching 
port (SWP) which are the pass 2020, 2030, and 2050 linked to a crossbar switch 201, and a port which 
connects I/F2040 between clusters. SWP2010 has the same structure altogether and performs switching 
control of the transfer path to other SWP(s) [ SWP / a certain ]. Although the transfer path is shown only 
about one SWP by a diagram, the same transfer path exists among all SWP(s). 

[0023] Drawing 5 is the block diagram showing the example of 1 configuration of the host I/F node 203. 
With this operation gestalt, in order to explain concretely, it is assumed that it is what uses a fiber channel 
for both host I/F31 and disk array I/F21. Of course, it is also possible as host I/F31 and disk array I/F21 
to apply interfaces other than a fiber channel. By using the same interface for both the host I/F node 203 
and the disk array I/F node 202, both are made to the same structure. In this operation gestalt, it is 
constituted like the host I/F node 203 which also shows the disk array I/F node 202 in drawing. Below, the 
host I/F node 203 is explained to an example. 

[0024] The retrieval processor which searches to which node 2021 transmits the received fiber channel 
frame (it is only called a frame below) (SP), 2022 is a host 30 (in the case of the disk array I/F node 202). 
The interface controller which transmits and receives a frame between the disk array subsets 10 (IC), The 
switching controller which changes based on the result with which SP2021 searched 2022 to the frame 
which IC2023 received (SC), The packet generation section packetHzed in the format that a crossbar 
switch 201 can be passed in order that 2024 may transmit the frame which SC2021 changed to other 
nodes (SPG), The frame buffer which stores temporarily the frame which 2025 received (FB), The 
exchange table which manages an exchange number for 2026 to identify the exchange (Exchange) which 
are two or more frame trains which corresponded to the disk array access request command (it is only 
called a command below) from one host (ET), 2027 is a disk array configuration management table (DCT) 
which stores the configuration information of two or more disk array subsets 10. 

[0025] As for each configuration sections of all of the disk array switch 20, it is desirable on the engine 
performance to consist of hardware logic. However, if the engine performance called for can be satisfied, it 
is also possible to realize the function of SP2021 or SC2022 by the program control using a general- 
purpose processor. 

[0026] Each disk array subset 10 has managed the disk unit 104 which each has as 1 or two or more logical 
disk units. This logical disk unit is called Logical unit (LU). LU does not need to correspond by the physical 



disk unit 104 and 1 to 1, and two or more LUs may be constituted by one set of a disk unit 104, or one LU 
may consist of two or more disk units 104. 

[0027] When it sees from the outside of the disk array subset 10, one LU is recognized as one set of a disk 
unit. With this operation gestalt, still more logical LU is constituted by the disk array switch 20, and a host 
30 operates so that it may access to this LU. On these specifications, when one LU recognized from a 
host 30 consists of an independent LU (ILU) and two or more LUs in LU recognized by the host 30 when 
<©ne LU recognized from a host 30 consists of one LU, LU recognized by the host 30 is called Integration 
LU(CLU). 

[0028] The correspondence relation of the address space between each hierarchy in case one integration 
LU is constituted from an LU of four disk array subsets by drawing 12 is shown. In drawing, the address 
• space in one integration LU of the disk array system 1 which saw 1000 from the host "#2", and 1100 show 
the address space of LU of the disk array subset 10 as an example, and 1200 shows the address space of 
a disk unit 104 (here, illustrated only about the disk array subset "#0"). 

[0029] LU of each disk array subset 10 shall be constituted as a RAIDS (Redundant Arrays of Inexpensive 
Disks Level 5) mold disk array by four sets of disk units 104 here. Each disk array subset 10 has LU which 
has the capacity of nO, n1, n2, and n3, respectively. The disk array switch 20 unifies the address space 
which these four LUs have to the address space which has the capacity of (n0+n1+n2+n3), and integration 
LU recognized from a host 30 is realized. 

[0030] With this operation gestalt, when host #2 access a field A1001, the access request which specified 
the field A1001 is changed into the demand for accessing the field A'1101 of LU of disk array subset #0 
with the disk array switch 20, and is transmitted to disk array subset #0, for example. Disk array subset #0 
accesses a field A'1101 further by mapping in 1201 A" of fields on a disk unit 104. Mapping between an 
address space 1000 and an address space 1100 is performed based on the configuration information held 
at DCT207 which the disk array switch 20 has. About the detail of this processing, it mentions later. In 
addition, it is the technique already well known about mapping in a disk array subset, and omits about 
detailed explanation on these specifications. 

[0031] In this operation gestalt, DCT207 contains a system configuration table and a subset configuration 
table. Drawing 6 shows the configuration of a system configuration table, and drawing 7 shows the 
configuration of a subset configuration table. 

[0032] As shown in drawing 7 , the system configuration table 20270 has the host LU configuration disk 
array I/F node configuration table 20271 and 20272 holding the information which shows Host's LU 
configuration showing the connection relation between the disk array I/F node 202 of the disk array switch 
20, and the disk array subset 10. 

[0033] The host LU configuration table 20271 has LU information (LU Info.) which is the information about 
LU of Host-LU No. which is the number which was seen from the host 30, and which identifies the LU for 
every LU, LU Type which shows the attribute of LU, CLU Class and CLU Stripe Size, Condition that is the 
information which shows Host's LU condition, and the disk array subset 10 which constitutes Host LU. 
[0034] LU Type is information which shows the class of LU whether this host LU is CLU or to be ILU. CLU 
Class is information which shows any of "Joined", "mirrored", and "Striped" that class is, when it is shown 
by LU Type that this host LU is CLU. "Joined" shows that CLU which connects some LUs and has one big 
storage space is constituted, as drawing 1 1 explained. "Mirrored" shows that it is LU doubled by two LUs 
so that it may mention later as the 6th operation gestalt "Striped" consists of two or more LUs, and 
shows that it is LU by which data were distributed and stored in LU of these plurality so that it may 
mention later as the 7th operation gestalt. CLU Stripe Size shows striping size (size of the block used as 
the unit of distribution of data), when it is shown by CLU Class that it is "Striped." 
[0035] There are four kinds of the conditions by which it is shown by Condition, "Normal", "Warning", 
"Fault", and "Not Defined." As for "Normal", this host LU shows that it is in a normal condition. "Warning" 
shows that degeneration operation is performed to one corresponding to LU which constitutes this host LU 
of disk units for the reason of the failure having occurred. "Fault" shows that this host LU cannot be 
operated by failure of the disk array subset 10 etc. "Not Defined" shows that the corresponding host LU of 
Host-LU No. is not defined. 

[0036] LU Info includes LUN within the information which specifies the disk array subset 10 to which that 
LU belongs about LU which constitutes this host LU, and a disk array subset, and the information which 
shows that size. When Host LU is ILU, the information about the only LU is registered. When Host LU is 
CLU, the information about each LU is registered about all LUs that constitute it. For example, in drawing, 
it is CLU which consists of four LUs, LUN "0" of a disk array subset "#0", LUN "0" of a disk array subset 
"#1 LUN "0" of a disk array subset "#2". and LUN "0" of a disk array subset "#3", and, as for Host-LU 
whose Host-LU No. is "0", it turns out that it is CLU the CLU class of whose is "Joined." 
[0037] The disk array I/F node configuration table 20272 holds the information which shows of which disk 



array switch 20 the disk array l/F node 202 is connected for every port of the disk array subset 10 which 
'disk array I/F21 connects. 

[0038] Specifically, it has Subset No. which specifies the disk array subset 10, Subset Port No. which 
pinpoints a port, Switch No. which specifies the disk array switch 20 linked to the port, and I/F Node No. 
which specifies the disk array I/F node 202 of the disk array switch 20. When the disk array subset 10 is 
equipped with two or more ports, information is set up for every port of the. 

{0039] A subset configuration table has two or more tables 202720-202723 corresponding to each disk 
array subset 10, as shown in drawing 7 . Each table contains LU configuration table 202740 holding the 
information which indicates the configuration of LU built in the disk array subset 10 to be the RAID group 
configuration table 202730 holding the information which shows a RAID group s configuration built within 
. the disk array subset 10. 

[0040] In a configuration of that striping of the RAID level 0 and the 5 grades was carried out, Group No. 
which shows the number by which the RAID group configuration table 202730 was added to the RAID 
group, Level which shows the RAID group's level, Disks which is the information which shows the number 
of the disks which constitute the RAID group, and its RAID group contain as information Stripe Size which 
shows the stripe size. For example, in the table shown in drawing, a RAID group "0" is a RAID group 
constituted by four sets of disk units, RAID level is 5 and stripe size is SO. 

[0041] LU configuration table 202740 contains as information LU No. which shows the number (LUN) added 
to LU, RAID Group which shows whether this LU is constituted by which RAID group, Condition which 
shows the condition of LU, Size which shows the size (capacity) of this LU, Port which shows whether this 
LU is accessible from the port of disk array subset 10 throat, and AltPort which shows the port used as 
that alternative. The condition by which it is shown by Condition has four kinds, "Normal", "Warning", 
"Fault", and "Not Defined", like Condition about Host LU. When a failure occurs in the port pinpointed for 
the information set as Port, it is used, but the port pinpointed using the information set as AltPort can 
also be used in order to only access the same LU from two or more ports. 

[0042] Drawing 8 is the block diagram of the frame in a fiber channel. The frame 40 of a fiber channel 
contains CRC (Cyclic RedundancyCheck)403 which is an error detection code with a frame payload of 402 
or 32 bits which is the part which stores SOF (Start Of Frame)400, the frame header 401, and the actual 
condition data of a transfer in which the head of a frame is shown, and EOF (End Of Frame)404 which 
shows the tail end of a frame. The frame header 401 has structure as shown in drawing 9 , and ID (SEQJD) 
of a sequence which specifies the frame group under each exchange ID specified by a response place 
(OXJD, RXJD) and exchange is stored the ID [ of the frame source ] (SJD), ID [ of the frame destination ] 
(DJD), and starting origin of an exchange. 

[0043] With this operation gestalt, ID by which ID assigned to the host 30 as SJD was assigned as DJD to 
the port of the disk array switch 20 again is used for the frame published by the host 30. The exchange ID 
of one pair (OXJD, RXJD) is assigned to one host command. When it is necessary to publish two or more 
data frames to the same exchange, the same SEQJD is assigned to all the data frames, and each is 
identified at a sequence count (SEQ^CNT). The maximum length of the frame payload 402 is 2110 bytes, 
and the contents stored for every frame kind differ. For example, in the case of the FCP.CMD frame 
mentioned later, as shown in drawing 10 , SCSI Logical Unit Number (LUN), Command Description Block 
(CDEf), etc. are stored. CDB contains a command cutting tool required for disk (disk array) access, the 
transfer initiation logical address (LBA), and transfer length (LEN). 

[0044] Hereafter, actuation of the disk array system of this operation gestalt is explained. 
[0045] Before using a disk array system, it is necessary to the disk array switch 20 to set up the 
configuration information of the disk array subset 10. A system administrator acquires all the disk array 
subsets 10 and the configuration setting information on the disk array switch 20 from an administration 
terminal 5 through the disk array system configuration means 70. A manager inputs setting information 
required for various setup, such as a configuration setup of Logical unit, a setup of RAID level, and a setup 
of the shift pass at the time of failure generating, so that it may become a desired system configuration 
from an administration terminal 5. The disk array system-configuration-control means 70 receives the 
setting information, and transmits setting information to each disk array subset 10 and the disk array 
switch 20. In addition, the 5th operation gestalt explains separately the input of the setting information in 
an administration terminal 5. 

[0046] With the disk array switch 20, the communication link controller 204 acquires setting information, 
and configuration information, such as address space information on each disk array subset 10, is set up by 
MP200. MP200 distributes the configuration information of the disk array subset 10 to each host I/F node 
203 and the disk array I/F node 202 by crossbar switch 201 course. 

[0047] Each nodes 203 and 202 store configuration information in DCT2027 by SP2021. if this information 
is received. In the disk array subset 10, the disk array subset configuration management means 106 



acquires setting information, and stores in a shared memory 102. Each high order MPU 1010 and low order 
MPU 1030 carry out each configuration management with reference to the setting information on a shared 
memory 102. 

[0048] Below, actuation when a host "#2" publishes a lead command to the disk array system 1 is 
explained. The flow chart of actuation [ in / for the mimetic diagram showing the sequence of the frame 
transmitted to drawing 1 1 through a fiber channel at the time of the lead actuation from a host / the host 
I/F node 203 of the disk array switch at this time ] is shown in drawing 13 . 

[0049] In addition, in the following explanation, a host "#2" assumes accessing the storage region A1001 in 
drawing 1 2 . A " of actual storage regions corresponding to a storage region A1001 shall exist in the 
address space of disk unit #2 which constitute LU of LUN=0 of a disk array subset "#0." Moreover, "CLlT 
- shall be set to LU Type of the host LU configuration table 20271 which defines LU which constitutes an 
address space 1000, and "Joined" shall be set to CLU Class. 

[0050] A host 30 publishes the command frame "FCP_CMD" which stored the lead command on the disk 
array switch 20 at the time of the lead of data ( drawing 1 1 arrow head (a)). The host I/F node "#2" of the 
disk array switch 20 receives a command frame "FCP_CMD" by host I/F31 course by IC2023 (step 20001). 
IC2023 transmits a command frame to SC2022. SC2022 once stores the received command frame in 
FB2025. Under the present circumstances, SC2022 calculates CRC of a command frame and inspects that 
receipt information is right If an error is in inspection of CRC, SC2022 will notify that to IC2023. IC2023 
will report a CRC error to a host 30 through host I/F31, if the notice of an error is received from SC2022. 
(Step 20002) . 

[0051] The frame to which CRC held SC2022 to FB2025 the right case is led, it recognizes that it is a 
command frame, and the frame header 401 is analyzed (step 20003). And SC2022 is directed to SP2021 
and registers exchange information, such as SJD, DJD, and OXJD, into ET2026 (step 20004). 
[0052] Next SC2022 analyzes the frame payload 402 and acquires LUN and CDB which were specified by 
the host 30 (step 20005). With directions of SC2022, SP2021 searches DCT2027 and gets the 
configuration information of the disk array subset 10. Specifically, SP2021 finds the information which has 
Host-LU No. which is in agreement with LUN stored in the frame payload 402 which searched the host LU 
configuration table 20271 and was received. SP2021 recognizes Host's LU configuration from the 
information set as LU Type and CLU Class, and distinguishes LUN of the disk subset 10 which should be 
accessed based on the information currently held at LU Info., and LU in it, and LBA within this LU. Next, 
with reference to LU configuration table 202740 of the subset configuration table 202720, SP2021 checks 
the connection port of the target disk array subset 10, and gets node No. of the disk array l/F node 202 
linked to the port from the disk array I/F node configuration table 20272. SP2021 reports the conversion 
information that the disk array subset 10 which carried out in this way and was obtained is identified, such 
as a number, and LUN, LBA, to SC2022. (Step 20006) . 

[0053] Next, SC2022 changes LBA in LUN and CDB of the frame payload 402 using the acquired 
conversion information. Moreover, DJD of the frame header 401 is changed into DJD of the corresponding 
host I/F controller 1011 of the disk array subset 10. In addition, SJD is not rewritten at this time (step 
20007). 

[0054] SC2022 transmits the disk array I/F node number linked to the command frame and the object disk 
array subset 10 after conversion to SPG2024. SPG2024 generates the packet which added the easy 
extended header 601 as shown in drawing 1 4 to the command frame after the received conversion. This 
packet is called the switching packet (S Packet) 60. In the extended header 601 of SPacket60, a source 
(selfHnode) number, a destination node number, and transfer length are ****** rare **. SPG2024 transmits 
generated S Packet60 to a crossbar switch 201 (step 20008). 

[0055] A crossbar switch 201 receives S Packet60 by SWP2010 linked to a host I/F node "#2." SWP2010 
performs switch control to SWP which the node of the destination connects with reference to the 
extended header 601 of S Packet60, establishes a path, and transmits S Packet60 to the disk array I/F 
node 202 (here disk array I/F node "#0") of the destination. SWP2010 will release the path, if it carries out 
at every reception of establishment of a path of S Packet60 and a transfer of S Packet60 is completed. In 
a disk array I/F node "#0", SPG2024 receives S Packet60, removes the extended header 601, and passes 
the part of a command frame to SC2022. 

[0056] SC2022 writes its ID in SJD of the frame header of the received command frame. Next, to SP2021, 
it points to SC2022 so that exchange information, such as SJD of a command frame, DJD, and OXJD, and 
a frame source host I/F node number may be registered into ET2026, and it transmits a command frame to 
IC2023. IC2023 transmits a command frame to the disk array subset 10 (here disk array subset "#0") to 
connect according to the information on the frame header 401 ( drawing 11 arrow head (b)). 
[0057] A disk array subset "#0" receives the command frame after conversion "FCP_CMD" by the disk 
array I/F controller 1011. It is recognized as a high order MPU 1010 being a command which acquires LUN 



and CDB which were stored in the frame payload 402 of a command frame, and leads the data of LEN 
•length fr.om LBA of the specified Logical unit 

[0058] A high order MPU 1010 performs cache hit mistake / hit judging with reference to the cache 
management information stored in the shared memory 102. If it hits, data transfer will be carried out from a 
cache 102. Since it is necessary to lead data from a disk unit in a mistake, address translation based on 
the configuration of RAID5 is carried out, and cache space is secured And processing information required 
■for lead processing from a disk unit 2 is generated, and processing information is stored in a shared 
memory 102 in order to take over processing to low order MPU 1030. 

[0059] Low order MPU 1030 starts processing ignited by processing information having been stored in the 
shared memory 102. Low order MPU 1030 specifies the suitable disk I/F controller 1031, generates the 
. lead command to a disk unit 2, and publishes a command for the disk I/F controller 1031. The disk I/F 
controller 1031 stores the data led from the disk unit 2 in the address with which the cache 102 was 
specified, and notifies a termination report to low order MPU 1030. Low order MPU 1030 stores processing 
termination information in a shared memory 102 that it should notify that processing was completed 
correctly to a high order MPU 1010. 

[0060] A high order MPU 1010 resumes processing ignited by processing termination information having 
been stored in the shared memory 102, and notifies lead data-preparation completion to the disk array I/F 
controller 1011. The disk array I/F controller 1011 publishes "FCP.XFER.RDY" which is a data transfer 
preparation-completion frame in a fiber channel to the disk array I/F node "#0" concerned of the disk 
array switch 20 ( drawing 11 arrow head (c)). 

[0061] In a disk array I/F node "#0", if a data transfer preparation-completion frame "FCP_XFER_RDY" is 
received, SC2022 will gain the response place exchange ID (RXJD) which received from the disk array 
subset 20, will specify SJD, DJD, and OXJD, will direct to SP2021, and will register RXJD into the 
exchange information concerned on ET2026. SC2022 gains the host I/F node number of the destination 
(source of a command frame) of a data transfer preparation-completion frame. SC2022 cancels SJD of this 
frame and transmits it to SPG2024. As SPG2024 was described previously, it generates S Packet, and it 
transmits it to a candidate host I/F node "#2" by crossbar switch 201 course. 

[0062] In a host I/F node "#2", if SPG2024 receives S Packet of a data transfer preparation-completion 
frame, the extended header of S Packet will be removed, "FCP^XFER^RDY" will be reproduced, and 
SC2022 will be passed (step 20011). SC2022 is directed to SP2021 and specifies the exchange which 
searchs ET2026 and corresponds (step 20012). 

[0063] Next, SC2022 investigates whether a frame is "FCPJKFER^RDY" (step 20013), and if it is 
"FCP_XFER_EDY", it will direct renewal of the response place exchange ID of ET2026 (RXJD) to SP2021. 
The value added to this frame is used as response place exchange ID (step 20014). And SC2022 changes 
SJD of the frame header 401, and DJD into the suitable value which used ID of the host I/F node 203, and 
a host's 30 ID (step 20015). The frame header 401 is changed into the frame to a host "#2" by these 
processings. IC2023 publishes this data transfer preparation-completion frame "FCP_XFER_RDY" to a host 
"#2" (the arrow head of drawing 1 1 (d): step 20016). 

[0064] In order that the disk array I/F controller 101 1 of a disk array subset "#0" may perform data 
transfer, it generates a data frame "FCP_DATA" and transmits it to the disk array switch 20 ( drawing 1 1 
arrow head (e)). Since the transfer length of a frame payload has a limit, the greatest data length which can 
be transmitted by one frame is 2KB. When a data length exceeds this, only a required number generates 
and publishes a data frame. The same SEQJD is assigned to all data frames. Issue of a data frame is the 
same as that of the case where it is a data transfer preparation-completion frame except for two or more 
frames being generated to the same SEQJD (that is, SEQ.CNT changing). 

[0065] The disk array switch 20 changes the frame header 401 of a data frame "FCPJDATA" like 
processing of a data transfer preparation-completion frame. However, since RXJD is already established in 
the transfer of a data frame, processing of step 20014 in processing of a data transfer preparation- 
completion frame is skipped. The disk array switch 20 transmits a data frame to a host "#2" after 
conversion of the frame header 401 ( drawing 1 1 arrow head (f)). 

[0066] Next, in order that the disk array I/F controller 101 1 of a disk array subset "#0" may perform an 
exit-status transfer, it generates a status frame "FCPJRSP" and publishes it to the disk array switch 20 
( drawing 1 1 arrow head (g)). With the disk array switch 20, like processing of a data transfer preparation- 
completion frame, SPG2024 removes an extended header from S Packet, reproduces a "FCPJRSP" status 
frame (step 20021), searches ET2026 by SP2021, and acquires exchange information (step 20022). SC2022 
changes a frame based on the information (20023 of a step). The changed frame is transmitted to a host 
"#2" by IC2023 ( drawing 1 1 arrow head (h): step 20024). Finally SP2021 deletes exchange information 
from ET2026 (step 20025). 

[0067] Lead processing from a disk array is performed as mentioned above. Lead processing mentioned 



above only by the direction of transfer of a data frame being reversed also about the light processing to 
the disk, array system 1 and same processing are performed. 

[0068] As shown in drawing 3 , the disk array switch 20 equips the crossbar switch 201 with I/F2040 
between clusters. I/F2040 between clusters is not used in the system configuration shown in drawing 1 . 
The disk array switch 20 of this operation gestalt is mutually connectable with other disk array switches, as 
shown in drawing 15 using I/F2040 between clusters. 

10069] the disk array switch 20 in this operation gestalt — although the disk array subset 10 is 
connectable only to a total of eight sets with a host 30 if independent, the number of disk arrays can be 
increased with the host 10 who interconnects and can connect two or more disk array switches using 
T/F2040 between clusters. For example, in the system shown in drawing 15 , the disk array subset 10 can 
. be connected to a total of 32 sets with a host 30 using four sets of the disk array switches 20, and data 
transfer becomes possible mutually among these. 

[0070] Thus, with this operation gestalt, the connection number of a disk array subset or a host can be 
increased according to the need for disk capacity or the engine performance. Moreover, since between 
host-disk array systems is connectable using host I/F for a required transfer band, the expandability of 
capacity, the engine performance, and the number of connection can be raised sharply. 
[0071] According to the operation gestalt explained above, even if the engine performance of one set of a 
disk array subset is restricted by internal MPU and an internal internal bus, it can interconnect between 
disk array subsets with a host with a disk array switch using two or more disk array subsets. Thereby, the 
engine performance high as a disk array system total is realizable. Even if the engine performance of a disk 
array subset is comparatively low, high performance-ization is realizable by using two or more disk array 
subsets. Therefore, according to the scale of a computer system, only the required number can connect 
the disk array subset of low cost, and it becomes possible to build a disk array system at the suitable cost 
according to a scale. 

[0072] Moreover, what is necessary is just to add a disk array subset as required when increase of disk 
capacity and improvement in the engine performance are needed. Furthermore, since the host and disk 
array subset of a number of arbitration are connectable using two or more disk array switches, both 
capacity the engine performance and the number of connection can be raised sharply, and the system 
which has high expandability can be realized. 

[0073] Since the contraction machine of the conventional disk array system itself can be used as a disk 
array subset according to this operation gestalt, the already developed large-scale control-software 
property can be used as it is, and reduction of development cost and compaction of a development cycle 
can be realized further again. 

[0074] [2nd operation gestalt] drawing 1 6 is the block diagram of the computer system in the 2nd operation 
gestalt of this invention. This operation gestalt changes only the frame header 401 in the host I/F node of 
a disk array switch, and the frame payload 402 is different from the 1st operation gestalt constitutionally at 
the point which the point which is not operated and a disk array switch, host I/F, and disk array I/F have 
not doubled. Therefore, the configuration of each part does not have the 1 st operation gestalt and the 
place which changes a lot, and omits explanation about the detail. 

[0075] In drawing 1 6 , each disk array subset 10 consists of two or more Logical unit (LU) 110. Each LU110 
is constituted as an independent LU. Generally, LUN assigned to LU110 in each disk array subset 10 is the 
consecutive number which begins from 0. For this reason, to show continuously LUN of all LUs110 in the 
disk array system 1 to a host 30, it is necessary to change the LUN field of the frame payload 402 like the 
1st operation gestalt With this operation gestalt, by showing a host 30 LUN of each disk array subset 10 
as it is, conversion of the frame payload 402 is made unnecessary and control of a disk array switch is 
made easy. 

[0076] The disk array switch 20 of this operation gestalt is assumed to be what can access the specific 
disk array subset 10 every host I/F node 203. In this case, if one host I/F31 is used, only LU1 10 in one set 
of the disk array subset 10 is accessible. The host is connected to two or more host I/F nodes 203 to 
access LU1 10 of two or more disk array subsets 10 from one set of a host. Moreover, when enabling it to 
access LU1 10 of one set of the disk array subset 10 from two or more hosts 30, loop-formation topology, 
fabric topology, etc. are used for the same host I/F node 203, and two or more hosts 30 are connected. 
Thus, since the disk array subset 10 will be decided for every DJD of the host I/F node 203 in case one 
LU1 10 is accessed from one set of a host 30 if constituted, it is possible to show a host 30 LUN of each 
LU as it is. 

[0077] With this operation gestalt, for the reason mentioned above, since LUN of LU1 10 in each disk array 
subset 10 is shown to the host 30 as it is at the host 30, conversion of LUN in the disk array switch 20 
becomes unnecessary. For this reason, the disk array switch 20 will change only the frame header 401 like 
the 1st example, if a frame is received from a host 30, and it transmits the frame payload 402 to the disk 



array subset 10, without changing. Since actuation of each part in this operation gestalt is the same as that 
of the 1st operation gestalt if it removes that conversion of the frame payload 402 is not performed, 
detailed explanation is omitted here. According to this operation gestalt, development of the disk array 
switch 20 can be made easy. 

[0078] With the 2nd operation gestalt of the [3rd operation gestalt], in the host I/F node of a disk array 
switch, although only the frame header is changed, by the 3rd operation gestalt explained below, the gestalt 
which does not change a frame is explained also including a frame header. The computer system of this 
operation gestalt is constituted like the computer system in the 1st operation gestalt shown in drawing 1 . 
[0079] With the 1st and 2nd operation gestalt internal configurations of the disk array system 1, such as 
the number of the disk array subset 10 and a configuration of LU1 10, are concealed to a host 30. For this 

. reason, from a host 30, the disk array system 1 appears as one storage on the whole. On the other hand, 
the disk array subset 10 is opened to a host 30 as it is, and a host 30 enables it to use ID of the port of a 
direct disk array subset as DJD of a frame header with this operation gestalt Thereby, a disk array switch 

" just needs to control a transfer of a frame according to the information on a frame header, and can change 
and use switching equipment equivalent to the fabric equipment of the fiber channel in the conventional 
technique for the disk array switch 20. 

[0080] The disk array system-configuration-control means 70 communicates with the means of 
communications 204 of the communication link controller 106 of the disk array subset 10, and the disk 
array switch 20, and gains or sets up the configuration information of each disk array subset 10 and the 
disk array switch 20. 

[0081] The disk array switch 20 has fundamentally the same configuration as the disk array switch in the 
1st operation gestalt shown in drawing 3 . However, in order to control a transfer of a frame by this 
operation gestalt using the information on the frame header of the frame which a host 30 publishes as it is, 
the function of conversion, such as DCT2027 which the host I/F node 203 of the disk array switch 20 and 
the disk array I/F node 202 have with the 1st operation gestalt or the 2nd operation gestalt, and a frame 
header realized by SC2022 and SPG2024 grade, becomes unnecessary. The crossbar switch 201 which the 
disk array switch 20 has transmits the frame of a fiber channel according to the information on a frame 
header between the host I/F node 203 and the disk array I/F node 202. 

[0082] With this operation gestalt in order to manage the disk array structure of a system collectively with 
the disk array system-configuration-control means 70, the disk array system-configuration-control means 
70 is equipped with a disk array administrative table (this table is also hereafter called DOT). DCT with 
which the disk array system-configuration-control means 70 is equipped contains two table groups, the 
system configuration table 20270 shown in drawing 6 and 7, and the subset configuration tables 202720- 
202723. In addition, with this operation gestalt since Host LU is altogether constituted as ILU, all LU Type 
(s) of the host LU configuration table 20271 serve as "ILU", and CLU Class and CLU Stripe Size do not 
make semantics. 

[0083] A manager operates an administration terminal 5, communicates with the disk array system- 
configuration-control means 70, acquires information, such as disk capacity of the disk array subset 10, 
and the number of a disk unit and performs a setup of LU1 10 of the disk array subset 10, a setup of RAID 
level, etc. Next a manager communicates with the disk array system-configuration-control means 70 with 
an administration terminal 5, controls the disk array switch 20, and sets up the related information between 
the disk array subsets 20 with each host 30. 

[0084] LU110 can come to be seen as the configuration of the disk array system 1 is established and a 
manager wishes from a host 30 by the above actuation. The disk array configuration management means 70 
can save the above setting information, and according to the actuation from a manager, the check of a 
configuration is performed and it can make a change of a configuration. 

[0085] Once it constitutes the disk array system 1 according to this operation gestalt existence of the 
disk array switch 20 cannot be made to be able to recognize from a manager, and two or more disk array 
subsystems can be treated like one set of a disk array system. Moreover, according to this operation 
gestalt the disk array switch 20 and the disk array subset 10 can be systematically operated according to 
the same operating environment, and the configuration check and a configuration change also become 
easy. Furthermore, without changing a setup of a host 30, when transposing the disk array system which 
was being used conventionally to the disk array system in this operation gestalt according to this operation 
gestalt it can double with the disk array structure of a system which was using the configuration of the 
disk array system 1 till then, and compatibility can be maintained. 

[0086] With the 1 st to 3rd operation gestalt explained beyond the [4th operation gestalt], the fiber channel 
is used for host I/F. The operation gestalt explained below explains the gestalt in which interfaces other 
than a fiber channel were intermingled. 

[0087] Drawing 17 shows the example of 1 configuration of IC2023 of the host I/F node 203 interior in 



case host I/F is Parallel SCSI. The SCSI protocol controller (SPC) by which 20230 performs protocol 
control. Qf Parallel SCSI, the fiber channel protocol controller (FPC) by which 20233 performs protocol 
control of a fiber channel, the protocol conversion processor (PEP) to which 20231 carries out protocol 
conversion of Serial SCSI of a fiber channel to Parallel SCSI, and 20232 are buffers (BUF) which save the 
data in protocol conversion temporarily. 

[0088] In this operation gestalt a host 30 publishes the SCSI command to the disk array I/F node 203. In 
the case of a lead command, SPC20230 stores this in BUF20232, and reports reception of a command to 
PEP20231 by interruption. PEP20231 uses the command stored in BUF20232, changes it into the command 
to FPC20233, and is sent to FPC20233. If this command is received, FPC20233 will be changed into a 
frame format and will be handed over to SC2022. Under the present circumstances, Exchange ID, 
Sequence ID, Source ID, and Destination ID are added by PEP20231 so that subsequent processings may 
be possible. Next command processing is performed like the 1st operation gestalt 
[0089] The disk array subset 10 will carry out issue of issue of a data transfer preparation-completion 
* frame, data transfer, and the status frame after normal termination, if preparation of data is completed. 
While the frame header 401 and the frame payload 402 are changed if needed, a transfer of various frames 
is performed from the disk array subset 10 before IC2023. FPC20233 of IC2023 receives a data transfer 
preparation-completion frame, it receives data continuously, stores them in BUF20232, and if a transfer 
finishes normally continuously, it will report data transfer completion, it receiving a status frame and 
applying interruption to PTP20231. If interruption is received, PTP20231 starts SPC20230 and directs that 
it starts data transfer to a host 30. If SPC20230 transmits data to a host 30 and normal termination is 
checked, it will report normal termination by interruption to PTP20231. 

[0090] Here, although Parallel SCSI was shown as an example of host I/F other than a fiber channel, it is 
possible to apply similarly to ESCON which are other interfaces, for example, host I/F to a mainframe. It is 
possible to make both so-called open systems, such as a mainframe, and a personal computer, a 
workstation, intermingled in one set of the disk array system 1, and to connect with it by preparing for 
example, a fiber channel and the host I/F node corresponding to Parallel SCSI and ESCON as a host I/F 
node 203 of the disk array switch 20. Although the fiber channel is used like the 1st to 3rd operation 
gestalt as disk array I/F with this operation gestalt, it is possible to use I/F of arbitration also to disk array 
I/F. 

[0091] The approach of the configuration management of the [5th operation gestalt], next the disk array 
system 1 is explained as the 5th operation gestalt. Drawing 18 is the system configuration Fig. of this 
operation gestalt With this operation gestalt the host 30 is formed four sets. I/F30 between the disk array 
systems 1 is connected with a host "#0" and "#1" by Parallel SCSI (Ultra2 SCSI) between the fiber 
channel, the host "#2", and the disk array system 1 between Parallel SCSI (Ultra SCSI), and a host "#3" 
and the disk array system 1. 

[0092] Connection with the disk array switch 20 of Parallel SCSI is made like the 4th operation gestalt The 
disk array system 1 has four sets of the disk array subsets 30. Two independent LUs are constituted by 
four independent LUs and the disk array subset "#1" at the disk array subset "#0", respectively. One 
integration LU consists of a disk array subset "#2" and "#3." With this operation gestalt, like the 1st 
operation gestalt the disk array subset 10 shall be concealed to a host 30, and the frame of a fiber channel 
shall be changed. LUN assigned to each LU — the order from LU of a disk array subset "#0" — LUN=0, 1 
and 2, and ... they are 7 **s to 6. 

[0093] Drawing 19 is an example of the screen displayed on the display screen of an administration 
terminal 5. Drawing is the logical connection configuration screen in which correspondence with host I/F31 
and each Logical unit (LU) was shown. 

[0094] The relation between the information 3100 about each host I/F31, the information 11000 about 
each LU110, the disk array subset 10, and LU110 etc. is displayed on the logical connection configuration 
screen 50. An l/F class, an I/F rate, the status, etc. are contained as information about host I/F31. As 
information about LU110, a storing subset number, LUN, capacity, RAID level, the status, information, etc. 
are displayed. By referring to this screen, a manager can manage the configuration of the disk array system 
1 easily. 

[0095] On the logical connection configuration screen 50, the line currently drawn between host I/F and 
LU shows accessible LU110 via each host I/F31. It cannot access from the host 30 who connects with the 
host I/F from host I/F to LU1 10 by which a line is not drawn. Since the data format to treat differs and a 
user also changes with hosts 30, it is indispensable on security maintenance to prepare a suitable access 
restriction. Then, the manager who sets up a system carries out access restriction by whether the access 
permission between each LU110 and host I/F is given using this screen. In drawing, although LU "#0" is 
accessible from host I/F "#0" and "#1", it cannot be accessed from host I/F "#2" and "#3." LU "#4" is 
accessible only from host I/F "#2." 



[0096] In order to realize such an access restriction, access-restriction information is transmitted from the 
disk array system-configuration-control means 70 to the disk array switch 20. The access-restriction 
information sent to the disk array switch 20 is distributed to each host I/F node 203, and is registered into 
DCT2027 of each host I/F node 203. When the inspection command of LU existence existence to LU to 
which access was restricted is published by the host, it is each host I/F node's 203 inspecting DCT2027, 
and not answering to an inspection command, or returning an error, and the LU is no longer recognized 
from a host by him. In the case of a SCSI protocol, generally as an inspection command of LU existence 
existence, the Test Unit Ready command and the Inquiry command are used. Since read/write is not 
carried out without this inspection, it is possible to apply a limit of access easily. 

[0097] Although access restriction is applied every host I/F31 with this operation gestalt, it is also easily 
realizable by extending this to apply access restriction every host 30. Moreover, host I/F31, a host 30, or 
an address space can be pinpointed, and the access restriction according to the classification of a 
command to which only the lead was told as good and which good, read/write, and good and read/write 
* told that only a light was improper can also be applied. In this case, a host I/F number, Host ID, an address 
space, a limit command, etc. are specified as access-restriction information, and a limit is set as the disk 
array switch 20. 

[0098] Next, the addition of the new disk array subset 10 is explained. When adding the disk array subset 
10 newly, a manager connects the disk array subset 10 added to the disk array l/F node 202 as for which 
the disk array switch 20 is vacant. Continuously, a manager operates an administration terminal 5 and does 
the depression of the carbon button 5001 "reflecting the newest condition" currently displayed on the 
logical connection configuration screen 50. This actuation is answered and the picture showing a non-set 
up disk array subset is displayed on a screen (not shown). If it carries out by choosing the picture of this 
disk array subset, the setting screen of a disk array subset will appear. A manager carries out various 
setup of the disk array subset added newly on the displayed setting screen. There are a configuration of 
LU, RAID level, etc. in the item set up here. Continuously, if it changes to the screen of the logical 
connection block diagram of drawing 1 9 , a new disk array subset and LU will appear. Henceforth, if the 
access restriction which receives every host I/F31 is set up and the depression of the "setting activation" 
carbon button 5002 is carried out, to the disk array switch 20, the information on access-restriction 
information and a disk array subset, and LU will be transmitted, and a setup will be performed. 
[0099] It is performed by the procedure which also mentioned above the procedure at the time of adding 
LU1 10 to each disk array subset 10. Moreover, it is performed by a disk array subset and the procedure 
with the same almost said of deletion of LU. A different point is a point performed, after a manager 
chooses each deletion part on a screen, and pushes "deletion" carbon button 5003 and a suitable check is 
performed. As mentioned above, a manager can manage the whole disk array system unitary by using an 
administration terminal 70. 

[0100] Processing of the [6th operation gestalt], next mirroring by the disk array switch 20 is explained as 
the 6th operation gestalt. Mirroring explained here is the approach of supporting duplex writing by two 
independent LUs of two sets of disk array subsets, and is the doubleness which even the controller of a 
disk array subset included. Therefore, dependability differs from doubleness of only a disk. 
[0101] The structure of a system in this operation gestalt is the same as what is shown in drawing 1 . the 
configuration shown in drawing 1 — it shall be, a disk array subset "#0" and "#1" shall completely be 
equipped with the same LU configuration, and these two disk array subsets shall be seen as one disk array 
from a host 30 For convenience, the number of the pair of the disk array subset by which mirroring was 
carried out is called "#01." Moreover, a mirroring pair is formed of LU "#0" and LU "#1" of each disk array 
subset, and the pair of this LU is called LU "#01" for convenience by them. "Mirrored" is set as CLU Class 
and, as for the information for managing LU#01 on the host LU configuration table 20271 of DCT2027, the 
information about LU#0 and LU#1 is set up as LU Info. The configuration of other each part is the same as 
that of the 1st operation gestalt 

[0102] Actuation of each part in this operation gestalt is the same as that of the 1st example almost. 
Hereafter, the point which is different from the 1st operation gestalt is explained focusing on actuation of 
the host I/F node 203 of the disk array switch 20. The mimetic diagram showing the sequence of the frame 
to which drawing 20 is transmitted at the time of the light actuation in this operation gestalt, drawing 21 , 
and 22 are flow charts which show the flow of processing by the host I/F node 203 at the time of light 
actuation. 

[0103] The light command frame (FCP_CMD) which the host 30 published is received by IC2023 at the time 
of light actuation (the arrow head of drawing 20 (a): step 21001). The light command frame received by 
IC2023 is step 20002 at the time of the lead actuation explained with the 1st operation gestalt It is 
processed like 20005 (step 21002-21005). 

[0104] SC2022 searches DCT2027 using SP2021, and recognizes that it is a light access request to LU 



"#01" of the mirror-ized disk array subset "#01" (step 21006). SC2022 creates the duplicate of the 
■comm^ntf frame which received on FB2025 (step 21007). SC2022 changes a command frame based on the 
configuration information set as DCT2027, and creates the separate command frame of both LU "#0" and 
LU (step 21008). Here, main LU and LU"#1" is called a main command frame and ** command frame 
for LU "#0" also to ** LU, a call, and a command frame, respectively, and both — exchange information is 
separately stored in ET2026, and the command frame created to the disk array subset "#0" and the disk 
array subset "#1" is published (the arrow head of drawing 20 (bO) (b1): step 21009). 

[0105] Each disk array subset "#0" and "#1" receive a command frame, and they transmit a data transfer 
preparation-completion frame (FCP_XFER_RDY) to the disk array switch 20 independently, respectively 
(arrow head of drawing 20 (cO) (cD). Step 2001 1 of lead actuation [ in / by the disk array switch 20 / in 
the host I/F node 203 / the 1st operation gestalt ] The data transfer preparation-completion frame 
transmitted by the same processing as 20013 is processed (step 21011-21013). 

[0106] In the phase which had complete set of data transfer preparation-completion frame from each disk 
■ array subset, (step 21014) and SC2022 carry out conversion to the main data transfer preparation- 
completion frame (step 21015), and transmit the frame after conversion to a host 30 by IC2023 (the arrow 
head of drawing 20 (d): step 21 01 5). 

[0107] A host 30 transmits a data frame (FCPJDATA) to the disk array switch 20 for light data 
transmission, after receiving a data transfer preparation-completion frame (arrow head of drawing 20 (e)). If 
the data frame from a host 30 is received by IC2023 (step 21031), like a lead command frame or a light 
command frame, it will be stored in FB2025 and CRC inspection and analysis of a frame header will be 
performed (steps 21032 and 21033). Based on the analysis result of a frame header, ET2026 is searched by 
SP2021 and exchange information is acquired (step 21034). 

[0108] SC2022 creates a duplicate like the time of a light command frame (step 21035), one of these is 
turned to LU "#0" in a disk array subset "#0", and turns another side to LU "#1" in a disk array subset 
"#1", and transmits (the arrow head of drawing 20 (fO) (f1): step 21037). 

[0109] A disk array subset "#0" and "#1" receive a data frame, it carries out a light to a disk unit 104, 
respectively, and they transmit a status frame (FCP_RSP) to the disk array switch 20. 
[01 10] SC2022 — a disk array subset "#0" and "#1" — respectively — since — if a status frame is 
received, an extended header will be removed from those status frames, a frame header will be reproduced, 
and exchange information will be acquired from ET2026 (steps 21041 and 21042). 

[0111] If the status frame from both disk array subset "#0" and "#1" gathers (step 21043), conversion to 
the main status frame from LU "#0" will be performed after a check of that the status is normal 
termination (step 21044), and ** status frame elimination will be carried out (step 21045). And IC2023 
transmits the command frame for reporting normal termination to a host (the arrow head of drawing 20 (h): 
step 21046). Finally SP2021 eliminates the exchange information on ET2026 (step 21047). 
[0112] The light processing in a mirroring configuration is completed above. Although lead processing to LU 
"#01" by which mirroring was carried out is performed almost like the light processing which the directions 
of a data transfer only differ and was mentioned above, unlike a light, it does not need to publish a lead 
command to two sets of disk array subsets, and should just publish a command frame to either. For 
example, because of improvement in the speed, although a command frame may always be published to the 
main LU, if a load is distributed by publishing a command frame by turns etc. to LU of the Lord/******, it 
is effective. 

[01 13] In the processing mentioned above, a synchronization of waiting and both is taken for the response 
of two sets "#0" of disk array subsets, and "#1" at step 21014 and step 21043, and processing is 
advanced. In such control, after a success of processing by both disk array subsets is checked, in order 
that processing may progress, the correspondence at the time of error generating becomes easy. On the 
other hand, in order that the whole processing speed may be dependent on the response of which or the 
later one, there is a fault that the engine performance falls. 

[0114] Since this problem is solved, when it progresses to the next processing, without waiting for the 
response of a disk array subset or there is a response from one of the disk array subsets, in a disk array 
switch, it is also possible to carry out "asynchronous" control which progresses to the next processing. In 
drawing 20 , a broken-line arrow head shows an example of the frame sequence at the time of performing 
asynchronous control. 

[0115] In the frame sequence shown by the broken-line arrow head, transmission of the data transfer 
preparation-completion frame to the host to whom it is carried out at step 21016 is carried out after 
processing of step 21009, without waiting for the data transfer preparation-completion frame from the disk 
array subset 10. In this case, the data transfer preparation-completion frame transmitted to a host is 
generated by SC2022 of the disk array switch 20 (broken-line arrow head (d')X 

[0116] From a host 30, a data frame is transmitted to the disk array switch 20 to the timing shown by the 



brokerHine arrow head (e'X With the disk array switch 20, this data frame is once stored in FB2025. 
•SC2022 .answers reception of the data transfer preparation-completion frame from the disk array subset 
10, and transmits the data frame held at FB2025 to the disk array subset 10 to which the data transfer 
preparation-completion frame has been sent (a broken-line arrow head (fO 1 ), (fT)X 
[01 17] The termination report to a host 30 from the disk array switch 20 is performed when there is a 
report (a broken-line arrow head (gOO, (gOO) from both disk array subsystems 10 (broken-line arrow head 
-0V)). It is possible only for the part of the time amount Ta shown in drawing 20 to shorten the processing 
time by such processing. 

[0118] The following processings are carried out when an error occurs in the middle of the frame transfer 

between the disk array switch 20 and the disk array subset 10. 
- [01 19] When the processing under activation is light processing, retry processing is performed to LU which 

the error generated. If a retry is successful, processing will be continued as it is. When the retry of the 

count of the convention set up beforehand goes wrong, the disk array switch 20 forbids access to this disk 
* array subset 10 (or LU), and registers into DCT2027 the information which shows that Moreover, the disk 

array switch 20 notifies that to the disc system configuration means 70 via MP200 and the communication 

link controller 204. 

[0120] The disc system configuration means 70 answers this notice, and publishes an alarm to an 
administration terminal 5. Thereby, a manager can recognize that the trouble occurred. Then, the disk array 
switch 20 continues operation using a normal disk array subset. A host 30 does not recognize that the 
error occurred and can continue processing. 

[0121] raising the failure-proof nature of a disk, since a mirror configuration is realizable with two sets of 
disk array subsystems according to this operation gestalt — things are made. Moreover, a disk array 
controller, disk array I/F, and the failure-proof nature of a disk array I/F node can be raised, there is 
nothing with ** which carries out doubieness of an internal bus etc., and the dependability of the whole 
disk array system can be raised. 

[0122] Three or more sets of the [7th operation gestalt], next the disk array subsets 10 are unified, and 
how to constitute the group of one set of a logical disk array subset is explained. Data are distributed and 
stored in two or more disk array subsets 10 with this operation gestalt Thereby, access to a disk array 
subset is distributed and a total throughput is raised by inhibiting concentration of access to a specific disk 
array subset With this operation gestalt, such striping processing is carried out with a disk array switch. 
[0123] Drawing 23 is the address map of the disk array system 1 in this operation gestalt Striping of the 
address space of the disk array subset 10 is carried out in the SUTOREIPU size S. The address space of 
the disk array system 1 seen from the host is distributed by every stripe size S a disk array subset "#0", 
"#1", "#2", and "#3." Although the size of the stripe size S is arbitrary, the direction which is not not 
much small is good. When the stripe size S was too small and the stripe crossover to which the data which 
should be accessed belong to two or more stripes occurs, a possibility that an overhead may occur is in 
the processing. If stripe size S is enlarged, since the probability for a stripe crossover to occur will 
decrease, for the improvement in the engine performance, it is desirable. The number of LUs can be set as 
arbitration. 

[0124] Hereafter, actuation of the host I/F node 203 in this operation gestalt is explained and explained 
paying attention to difference with the 1st operation gestalt, referring to the operation flow chart shown in 
drawing 24 . In addition, with this operation gestalt, "Striped" is set to CLU Class of the information about 
the host LU by whom striping was done on the host LU configuration table 20271 of DCT2027, and stripe 
size "S" is set to CLU Stripe Size. 

[0125] If a host 30 publishes a command frame, the disk array switch 20 will recognize that SC2022 which 
receives this (step 22001) needs to search DCT2027, and needs to carry out striping of this command 
frame using reception and SP2021 from IC2023 by IC2023 of the host I/F node 203 (step 22005). 
[0126] Next SC2022 searches DCT2027 by SP2021, asks for the stripe number of the stripe with which 
the data set as the object of access belong from the configuration information containing the stripe size S, 
and specifies in which disk array subset 10 this stripe is stored (step 22006). Under the present 
circumstances, although a stripe crossover may occur, about the processing in this case, it mentions later. 
When a stripe crossover does not occur, based on SP's2021 count result, SC2022 changes to a command 
frame (step 22007), and stores exchange information in ET2026 (step 22008). Henceforth, the same 
processing as the 1st operation gestalt is performed. 

[0127] When a stripe crossover occurs, SP2021 generates two command frames. This generation is 
performed with reproducing the command frame which the host 30 published. The frame header of the 
command frame to generate, a frame payload, etc. are set up newly. Although it is also possible like the 6th 
operation gestalt to carry out conversion after creating the duplicate of a command frame by SC2022, it 
shall be newly created by SP2021 here. SC2022 will transmit these to each disk array subset 1 0, if two 



command frames are generated. 

[0128] Then, data transfer is carried out like the 1st operation gestalt Here, unlike the 1st operation 
gestalt or the 6th operation gestalt, it is necessary to transmit the data itself with this operation gestalt in 
one set of the two sets of a host 30 and the disk array subsets 10. For example, in lead processing, it is 
necessary to transmit all the data frames transmitted from two sets of the disk array subsets 10 to a host 
30. Under the present circumstances, to the data frame transmitted from each disk array subset 10, 
according to the exchange information registered into ET2026, SC2022 is suitable sequence, adds suitable 
exchange information and transmits to a host 30. 

[0129] In light processing, it transmits to the disk array subset 10 which divides and corresponds to two 
data frames like the case of a command frame. In addition, the sequence control of a data frame is not 
indispensable if the host or the disk array subset supports the processing in random order called an 
AUTOOBU order (Out of Order) function. 

[0130] If all data transfer is completed and the disk array switch 20 finally receives two status frames from 
• the disk array subset 10, SP2021 (or SC2022) will create the status frame to a host 30, and will transmit 
this to a host 30 by IC2023. 

[0131] Since access can be distributed to two or more disk array subsets, while being able to raise a 
throughput as total according to this operation gestalt, also as for an access latency, it is possible to make 
it decrease on the average. 

[0132] Creation of the duplicate for two sets (or disk array subset) of the [8th operation gestalt], next disk 
array systems is explained as the 8th operation gestalt. A system which is explained here arranges one 
side of two sets of disk array systems to a remote place, and is equipped with the resistance over the 
failure of the disk array system of another side by a natural disaster etc. The thing of creation of the 
duplicate performed between a disaster recovery, and a call and the disk array system of a remote place in 
a cure to such a disaster is called a remote copy. 

[0133] Since mirroring explained with the 6th operation gestalt constitutes a mirror from the disk array 
subset 10 installed in the geographical almost same location, disk array I/F21 is good by the fiber channel. 
However, when the disk array (disk array subset) which performs a remote copy is installed in the remote 
place exceeding 10km, you cannot transmit a frame without junction by the fiber channel. Since [ this ] the 
distance between each other is usually set to hundreds of km or more when used for a disaster recovery, it 
is impossible practically to connect between disk arrays by the fiber channel, and a high-speed public line, 
satellite communication, etc. by ATM (Asynchronous Transfer Mode) etc. are used. 

[0134] Drawing 25 is an example of the disaster recovery structure of a system in this operation gestalt 
[0135] 81 is Site A, 82 is Site B, and both sites are installed in a geographical remote place. 9 is a public 
line and an ATM packet passes through this. A site A81 and a site B82 have the disk array system 1, 
respectively. Here a site A81 is a common site usually used, and a site B82 is a remote disaster recovery 
site used when a site A81 is downed with disaster etc. 

[0136] The contents of the disk array subset "#0" of the disk array system 10 of a site A81 and "#1" are 
copied to the disk array subset for a remote copy of the disk array system 10 of a site B82 "#0", and 
"#1." What is connected to a remote site among the I/F nodes of the disk array switch 20 is connected to 
the public line 9 using ATM. This node is called the ATM node 205. The ATM node 205 is constituted like 
the host [/F node shown in drawing 5 , and IC2023 changes an ATM-fiber channel. This conversion is 
realized by the same approach as conversion of the SCSI-fiber channel in the 4th operation gestalt. 
[0137] Processing of the remote copy in this operation gestalt is similar with processing of mirroring in the 
6th operation gestalt. Hereafter, a different point from processing of mirroring in the 6th operation gestalt 
is explained. 

[0138] If a host 30 publishes a light command frame, the disk array system 10 of a site A81 will double a 
frame like the case in the 6th operation gestalt, and will transmit one of these to the own disk array subset 
10. The frame of another side is changed into an ATM packet from a fiber channel frame by the ATM node 
205, and is sent to a site B82 through a public line 9. 

[0139] To a site B82, the ATM node 205 of the disk array switch 20 receives this packet. [C2023 of the 
ATM node 205 reproduces a fiber channel frame from an ATM packet, and transmits it to SC2022. SC2022 
performs frame conversion like the time of receiving a light command from a host 30, and transmits it to 
the disk array subset for a remote copy. Henceforth, in data transfer preparation-completion frames, data 
frames, and all the status frames, a remote copy is realizable by performing fiber channel-ATM conversion 
in the ATM node 205, and carrying out same frame transfer processing. 

[0140] When a host 30 publishes a lead command frame, the disk array switch 20 transmits a command 
frame only to the disk array subset 10 of a self-site, and leads data only from the disk array subset 10 of a 
self-site. The actuation at this time becomes the same as that of the 1st operation gestalt 
[0141] According to this operation gestalt, user data can be backed up on real time and it can have the 



resistance over the site failure by a natural disaster etc., and disk array system failure. 
'[0142] Integration of two or more LUs included by one set of the [9th operation gestalt], next the disk 
array subset 10 is explained. For example, in order that the disk unit for main frames may maintain 
compatibility with the past system, the maximum of the size of a logical volume is set as 2GB. When 
sharing such a disk array system also with an open system, LU will receive a limit of logical volume size as 
it is, and many its LUs of small size can be seen from a host By such approach, when large capacity- 
jzation progresses, the problem that employment becomes difficult arises. Then, it considers unifying this 
logical volume (namely, LU) and constituting one big integration LU by the function of the disk array switch 
20. In this operation gestalt, integration LU is created with the disk array switch 20. 

[0143] Integration of LU in this operation gestalt is the same as that of creation of the integration LU by 
. two or more disk array subsets 10 which can be set in the 1st operation gestalt Difference is only 
integration by the plurality LU in the same disk array subset 10. The actuation as a disk array system 
becomes completely the same as that of the 1st operation gestalt 

[0144] Thus, by unifying two or more LUs included by the same disk array subset 10, and creating one big 
LU f it becomes unnecessary to manage many LUs from a host, and excels in operability, and the disk array 
system which reduced management cost can be built 

[0145] The setting approach of the [10th operation gestalt], next the shift pass by the disk array switch 10 
is explained referring to drawing 26 . 

[0146] The configuration of each part in the computing system shown in drawing 26 is the same as that of 
the 1st operation gestalt Here, if two sets of hosts 30 access the disk array subset 10 using respectively 
different disk array I/F21, it will be assumed that it constitutes like. By a diagram, only the number which 
needs the host I/F node 203 and the disk array I/F node 202 of a disk array subset and the disk array 
switch 20 for explanation here is shown. 

[0147] The disk array subset 10 had the same configuration as drawing 2 , and has connected two disk 
array I/F controllers to one set of the disk array switch 20, respectively. The shift pass of disk array I/F21 
is set to DCT227 of each node of the disk array switch 20. Shift pass is pass of the alternative established 
so that it may become accessible, also when a failure occurs on one certain pass. Here, the shift pass of 
disk array I/F "#1" and disk array I/F "#1" is set for the shift pass of disk array I/F "#0" as disk array I/F 
"#0." Similarly, shift pass is set also about each between the high order adapters in the disk array subset 
10, between a cache and alternate memory, and between low order adapters. 

[0148] Next, as shown in drawing 26 , disk array I/F21 linked to the high order adapter "#1" of the disk 
array subset 1 is disconnected, it assumes that the failure occurred, and the setting-operation of shift 
pass is explained. It becomes impossible for the host "#1" using disk array I/F21 which the failure 
generated to access the disk array subset 10 at this time. It is recognized as the failure having generated 
the disk array switch 20 on this pass, when not recovering, even if it detected the abnormalities of the 
frame transfer between the disk array subsets 10 and carried out retry processing. 

[0149] If the failure of pass occurs, SP2021 will register that the failure occurred in disk array I/F "#1" 
into DCT2027, and will register using disk array I/F "#0" as shift pass. Henceforth, SC2022 of the host I/F 
node 203 operates so that the frame from a host "#1" may be transmitted to the disk array I/F node 202 
linked to disk array I/F "#0." 

[0150] The high order adapter 101 of the disk array subset 10 succeeds and processes the command from 
a host "#1." Moreover, the disk array switch 20 notifies generating of a failure to the disk array system- 
configuration-control means 70, and generating of a failure is notified to a manager by the disk array 
system-configuration-control means 70. 

[0151] According to this operation gestalt, a change on the shift pass at the time of a failure occurring on 
pass can be performed without making it recognize to a host side, and a shift processing setup by the side 
of a host can be made unnecessary. Thereby, the availability of a system can be raised. 
[0152] Each operation gestalt explained above explained the disk array system which used the disk unit 
altogether as storage media. However, this invention is not limited to this, and when not only a disk unit but 
an optical disk unit, a tape unit DVD equipment a semiconductor memory, etc. are used as storage media, 
it can be applied similarly. 
[0153] 

[Effect of the Invention] According to this invention, the storage system which can realize easily escape of 
the storage system according to the scale of a computing system, a demand, etc., improvement in 
dependability, etc. is realizable. 
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' TECHNICAL FIELD 

- [Field of the Invention] This invention relates to the approach of improvement in the speed of a disk 
control system, low-cost-izing, and improvement in cost performance especially about the implementation 
approach of the disk control system which controls two or more disk units. 
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PRIOR ART 



- [Description of the Prior Art] There is a disk array system which controls two or more disk units as a store 
system used for a computer system. About a disk array system, it is "A Case for Redundant Arrays of 
Inexpensive Disks" (RAID), for example.; It is indicated by InProcACM SIGMOD and June 1988 (University 
of California at Berkeley issue). A disk array is operating two or more disk units to juxtaposition, and is the 
technique of realizing improvement in the speed compared with the storage system which used the disk 
unit alone. 

[0003] There is an approach which used Fabric of a fiber channel (Fibre Channel) as an approach of 
connecting two or more disk array systems mutually with two or more hosts, the example of the computing 
system which applied this approach — Nikkei electronics 1995.7.3 (no.639) "Serial SCSI is to commercial 
scene still more" P.79 It is shown in drawing 3 . In the computing system indicated here, two or more host 
computers (below, it is only called a host) and two or more disk array systems are connected to fabric 
equipment through a fiber channel, respectively. Fabric equipment is the switch of a fiber channel and 
connects the transfer way between the equipment of the arbitration linked to fabric equipment Fabric 
equipment is transparency to a transfer of the "frame" which is the packet of a fiber channel, and a host 
and a disk array system communicate in two points, without being conscious of fabric equipment of each 
other. 
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EFFECT OF THE INVENTION 

- [Effect of the Invention] According to this invention, the storage system which can realize easily escape of 
the storage system according to the scale of a computing system, a demand, etc., improvement in 
dependability, etc. is realizable. 
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TECHNICAL PROBLEM 



- [Problem(s) to be Solved by the Invention] In the conventional disk array system, the number of a disk unit 
is increased for large-capacity-izing, and if it is going to realize the controller which has the engine 
performance which balanced the number for high-performance-izing, the performance limit of the internal 
bus of a controller and the performance limit of the processor which performs transfer control will 
actualize. In order to cope with such a problem, an internal bus is extended and increasing the number of 
processors is performed. However, the method of such management causes the complication of control 
software and the increment in an overhead by complication of a controller configuration, exclusive control 
of the share data of interprocessor, etc. by much bus control. For this reason, while raising cost very much, 
the engine performance is reaching the ceiling, consequently cost performance gets worse. Moreover, in a 
large-scale system, although such equipment can realize the engine performance corresponding to the 
cost, there is a technical problem which does not balance that the increase of a development cycle and the 
rise of development cost to which expandability is restricted are caused in the system whose scale is not 
so large. 

[0005] By putting two or more disk array systems in order, and interconnecting with fabric equipment, it is 
possible to perform large-capacity-izing as the whole system and high performanceHzation. However, by 
this approach, since it cannot be distributed to other equipments even if it is irrelevant between disk array 
systems and access concentrates on a specific disk array system, high performance-ization on real use is 
unrealizable. Moreover, since the capacity of the logical disk unit (it is called Logical unit) seen from the 
host is restricted to the capacity of one set of a disk array system, large capacity-ization of Logical unit is 
unrealizable. 

[0006] Although the mirror configuration by two sets of disk array systems can be realized using the 
mirroring function which the host has when it is going to form the whole disk array system into high 
reliance, the control overhead for mirroring by the host occurs, and the technical problem that system 
performance is restricted occurs. Moreover, if many disk array systems exist according to an individual in a 
system, a load for a system administrator to manage will increase. For this reason, management cost 
increases — many maintenance staffs and the maintenance costs for two or more sets are needed. 
Furthermore, since two or more disk array systems and fabric equipment are isolated systems, 
respectively, it is necessary to carry out various setup by different approach for every equipment. For this 
reason, employment cost increases with a manager's training and increase of an operate time. 
[0007] The purpose of this invention solves the technical problem in these conventional technique, can 
build the storage system according to the scale of a computing system, a demand, etc., and is to realize 
the storage system which can respond to the escape of the storage system in the future, improvement in 
dependability, etc. easily. 



[Translation done.] 
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MEANS ^ 

- [Means for Solving the Problem] The store which has the storage with which the store system of this 
invention holds data, Two or more store subsystems which have the control device which controls this 
store, The 1st interface node connected to the computer which uses the data held at two or more store 
subsystems, Two or more 2nd interface nodes by which each was connected to either of the store 
subsystems, And the 1st interface node and two or more 2nd interface nodes are connected, and it has a 
transfer means to transmit a frame between the 1st interface node and two or more 2nd interface nodes. 
[0009] Preferably, the 1st interface node answers the frame sent from a calculating machine, analyzes this 
frame, carries out signal transduction to the configuration management table which stored store structure- 
ol^a-system information about the destination of the frame based on the configuration information held at 
the configuration management table, and is transmitted to a transfer means. 

[0010] Moreover, on the occasion of a transfer of a frame, the 1st interface node adds the node address 
information on the node which should receive the frame to a frame. A transfer means transmits a frame 
according to the node address information added to the frame. The 2nd interface node carries out the 
reconstititution of the frame except for node address information from the frame received from the 
transfer means, and transmits it to the target store subsystem. 

[0011] In a mode with this invention, a storage system has a management processor linked to a transfer 
means. A management processor sets configuration information as a configuration management table 
according to the directions from an operator. The information which restricts access from a computer is 
included in configuration information. 
[0012] 

[Embodiment of the Invention] [1st operation gestalt] drawing 1 is a block diagram in 1 operation gestalt of 
the computer system using the disk array system by which this invention was applied. 

[0013] It is the host computer (host) to which, as for 1, a disk array system is connected to, and, as for 30, 
a disk array system is connected. The disk array system 1 has the communication interface 80 between 
the disk array system-configuration-control means 70, and the disk array switch 20 and the disk array 
system-configuration-control means 70 of performing setting management of the disk array subset 10, the 
disk array switch 20, and the whole disk array system, and between the disk array subset 10 disk-array 
system-configuration-control means 70 (communication link I/F). It connects with the host interface (host 
I/F) 31, and a host 30 and the disk array system 1 connect host I/F31 to the disk array switch 20 of the 
disk array system 1. In the interior of the disk array system 1, the disk array switch 20 and the disk array 
subset 10 are connected with a disk array interface (disk array I/F21). 

[0014] Although a host 30 and four disk array subsets 10 are shown respectively, they are [ no limit ] 
about this number and are arbitrary by a diagram. The number of a host 30 and the disk array subset 10 
may differ. Moreover, the disk array switch 20 is doubled with this operation gestalt as illustration. Each 
host 30 and each disk array subset 10 are connected to the both sides of the disk array switch 20 doubled 
by respectively separate host I/F31 and disk array I/F21. This is for enabling access to the disk array 
system 1 from a host 30 by using another side, even if one disk array switch 20, host I/F31, or disk array 
I/F21 breaks down, and realizing high availability. However, such doubleness is not necessarily 
indispensable and is selectable according to the reliability level required of a system. 

[0015] Drawing 2 is the block diagram showing the example of 1 configuration of the disk array subset 10. 
The high order adapter which 101 interprets the command from host system (host 10), carries out a cache 
hit mistake judging, and controls the data transfer between host system and a cache, the shared memory 
(it is called a cache and a shared memory below) in which 102 stores the cache for disk data-access 
improvement in the speed and the share data between multiprocessors, and 104 are two or more disk units 
stored in the disk array subset 10. 103 is a low order adapter which controls a disk unit 104 and controls 
the data transfer between a disk unit 104 and a cache. 106 is a disk array subset configuration 
management means, communicates through the disk array system-configuration-control means 70 and 



communication link [/F80 which manage the disk array system 1 whole, and manages a setup of a 
configuration parameter, the report of fault information, etc. 

[0016] The high order adapter 101, a cache and a shared memory 102, and the low order adapter 103 are 
doubled, respectively. Like doubleness of the above-mentioned disk array switch 20, this reason is for 
realizing the sex for Takayoshi, and is not indispensable. Moreover, either of the doubled low order adapters 
103 of each disk unit 104 is also controllable. Although the same memory means is shared from a viewpoint 
of low-costHzing to the cache and the shared memory with this operation gestalt, of course, these can 
also be dissociated. 

[0017] The high order adapter 101 includes the high order bus 1012 which performs communication link 
between a cache and a shared memory 102, and a high order MPU 1010 and the disk array I/F controller 
- 1011, and data transfer. [ the high order MPU 1010 which performs control of the high order adapter 101, 
host system 1011, i.e., the disk array I/F controller which controls disk array I/F21 which is connection I/F 
with the disk array switch 20, and ] 

[0018] Although one disk array I/F controller 1011 is shown every high order adapter 101 by a diagram, two 
or more disk array I/F controllers 1011 may be formed to one high order adapter. 

[0019] The low order adapter 103 includes the low order bus 1032 which performs communication link 
between a cache and a shared memory 102, and the low order MPU 1030 and the disk I/F controller 1031 
which control disk I/F which is an interface with the low order MPU 1030 which performs control of the low 
order adapter 103, and a disk 104, and data transfer, [the disk I/F controller 1031, and ] 
[0020] Although four disk I/F controllers 1031 are shown every low order adapter 103 by a diagram, the 
number is arbitrary and can be changed according to the configuration and the number of a disk to connect 
of a disk array. 

[0021] Drawing 3 is the block diagram showing the example of 1 configuration of the disk array switch 20. 
The management processor (MP) which is a processor to which 200 performs control and management of 
the whole disk array switch, the crossbar switch with which 201 constitutes the mutual switch path of nxn, 
the disk array I/F node in which 202 is prepared every disk array I/F21, the host I/F node in which 203 is 
prepared every host I/F31, and 204 are communication link controllers which perform the communication 
link between the disk array system-configuration-control means 70. I/F between clusters for the pass 
whose 2020 connects a crossbar switch 201 with the disk array I/F node 202, the pass on which 2030 
connects a crossbar switch 201 with the host I/F node 203, and 2040 to connect with other disk array 
switches 20, and constitute a cluster, and 2050 are the pass for connecting a crossbar switch 201 with 
MP200. 

[0022] Drawing 4 is the block diagram showing the structure of a crossbar switch 201. 2010 is a switching 
port (SWP) which are the pass 2020, 2030, and 2050 linked to a crossbar switch 201, and a port which 
connects I/F2040 between clusters. SWP2010 has the same structure altogether and performs switching 
control of the transfer path to other SWP(s) [ SWP / a certain ]. Although the transfer path is shown only 
about one SWP by a diagram, the same transfer path exists among all SWP(s). 

[0023] Drawing 5 is the block diagram showing the example of 1 configuration of the host I/F node 203. 
With this operation gestalt, in order to explain concretely, it is assumed that it is what uses a fiber channel 
for both host I/F31 and disk array I/F21. Of course, it is also possible as host I/F31 and disk array I/F21 
to apply interfaces other than a fiber channel. By using the same interface for both the host I/F node 203 
and the disk array I/F node 202, both are made to the same structure. In this operation gestalt, it is 
constituted like the host I/F node 203 which also shows the disk array I/F node 202 in drawing. Below, the 
host I/F node 203 is explained to an example. 

[0024] The retrieval processor which searches to which node 2021 transmits the received fiber channel 
frame (it is only called a frame below) (SP), 2022 is a host 30 (in the case of the disk array I/F node 202). 
The interface controller which transmits and receives a frame between the disk array subsets 10 (IC), The 
switching controller which changes based on the result with which SP2021 searched 2022 to the frame 
which IO2023 received (SC), The packet generation section packet-ized in the format that a crossbar 
switch 201 can be passed in order that 2024 may transmit the frame which SC2021 changed to other 
nodes (SPG), The frame buffer which stores temporarily the frame which 2025 received (FB), The 
exchange table which manages an exchange number for 2026 to identify the exchange (Exchange) which 
are two or more frame trains which corresponded to the disk array access request command (it is only 
called a command below) from one host (ET), 2027 is a disk array configuration management table (DCT) 
which stores the configuration information of two or more disk array subsets 10. 

[0025] As for each configuration sections of all of the disk array switch 20, it is desirable on the engine 
performance to consist of hardware logic. However, if the engine performance called for can be satisfied, it 
is also possible to realize the function of SP2021 or SC2022 by the program control using a general- 
purpose processor. 



[0026] Each disk array subset 10 has managed the disk unit 104 which each has as 1 or two or more logical 
'disk units. This logical disk unit is called Logical unit (LU). LU does not need to correspond by the physical 
di % sk unit 104 and 1 to 1, and two or more LUs may be constituted by one set of a disk unit 104, or one LU 
may consist of two or more disk units 104. 

[0027] When it sees from the outside of the disk array subset 10, one LU is recognized as one set of a disk 
unit. With this operation gestalt, still more logical LU is constituted by the disk array switch 20, and a host 
130 operates so that it may access to this LU. On these specifications, when one LU recognized from a 
host 30 consists of an independent LU (ILU) and two or more LUs in LU recognized by the host 30 when 
one LU recognized from a host 30 consists of one LU, LU recognized by the host 30 is called Integration 
LU (CLU). 

- [0028] The correspondence relation of the address space between each hierarchy in case one integration 
LU is constituted from an LU of four disk array subsets by drawing 1 2 is shown. In drawing, the address 
space in one integration LU of the disk array system 1 which saw 1000 from the host "#2", and 1100 show 
the address space of LU of the disk array subset 10 as an example, and 1200 shows the address space of 
a disk unit 104 (here, illustrated only about the disk array subset "#0"). 

[0029] LU of each disk array subset 10 shall be constituted as a RAIDS (Redundant Arrays of Inexpensive 
Disks Level 5) mold disk array by four sets of disk units 104 here. Each disk array subset 10 has LU which 
has the capacity of nO, n1, n2, and n3, respectively. The disk array switch 20 unifies the address space 
which these four LUs have to the address space which has the capacity of (n0+n1+n2+n3), and integration 
LU recognized from a host 30 is realized. 

[0030] With this operation gestalt when host #2 access a field A1001, the access request which specified 
the field A1001 is changed into the demand for accessing the field A'1 101 of LU of disk array subset #0 
with the disk array switch 20, and is transmitted to disk array subset #0, for example. Disk array subset #0 
accesses a field A'1101 further by mapping in 1201 A" of fields on a disk unit 104. Mapping between an 
address space 1000 and an address space 1100 is performed based on the configuration information held 
at DCT207 which the disk array switch 20 has. About the detail of this processing, it mentions later. In 
addition, it is the technique already well known about mapping in a disk array subset, and omits about 
detailed explanation on these specifications. 

[0031] In this operation gestalt, DCT207 contains a system configuration table and a subset configuration 
table. Drawing 6 shows the configuration of a system configuration table, and drawing 7 shows the 
configuration of a subset configuration table. 

[0032] As shown in drawing 7 , the system configuration table 20270 has the host LU configuration disk 
array I/F node configuration table 20271 and 20272 holding the information which shows Host's LU 
configuration showing the connection relation between the disk array I/F node 202 of the disk array switch 
20, and the disk array subset 10. 

[0033] The host LU configuration table 20271 has LU information (LU Info.) which is the information about 
LU of Host-LU No. which is the number which was seen from the host 30, and which identifies the LU for 
every LU, LU Type which shows the attribute of LU, CLU Class and CLU Stripe Size, Condition that is the 
information which shows Host's LU condition, and the disk array subset 10 which constitutes Host LU. 
[0034] LU Type is information which shows the class of LU whether this host LU is CLU or to be ILU. CLU 
Class is information which shows any of "Joined", "mirrored", and "Striped" that class is, when it is shown 
by LU Type that this host LU is CLU. "Joined" shows that CLU which connects some LUs and has one big 
storage space is constituted, as drawing 1 1 explained. "Mirrored" shows that it is LU doubled by two LUs 
so that it may mention later as the 6th operation gestalt "Striped" consists of two or more LUs, and 
shows that it is LU by which data were distributed and stored in LU of these plurality so that it may 
mention later as the 7th operation gestalt CLU Stripe Size shows striping size (size of the block used as 
the unit of distribution of data), when it is shown by CLU Class that it is "Striped." 
[0035] There are four kinds of the conditions by which it is shown by Condition, "Normal", "Warning", 
"Fault", and "Not Defined." As for "Normal", this host LU shows that it is in a normal condition. "Warning" 
shows that degeneration operation is performed to one corresponding to LU which constitutes this host LU 
of disk units for the reason of the failure having occurred. "Fault" shows that this host LU cannot be 
operated by failure of the disk array subset 10 etc. "Not Defined" shows that the corresponding host LU of 
Host-LU No. is not defined. 

[0036] LU Info includes LUN within the information which specifies the disk array subset 10 to which that 
LU belongs about LU which constitutes this host LU, and a disk array subset, and the information which 
shows that size. When Host LU is ILU, the information about the only LU is registered. When Host LU is 
CLU, the information about each LU is registered about all LUs that constitute it. For example, in drawing, 
it is CLU which consists of four LUs, LUN "0" of a disk array subset "#0", LUN "0" of a disk array subset 
"#1", LUN "0" of a disk array subset "#2", and LUN "0" of a disk array subset "#3", and, as for Host-LU 



whose Host-LU No. is "0", it turns out that it is CLU the CLU class of whose is "Joined" 
[0037] The disk array I/F node configuration table 20272 holds the information which shows of which disk 
array switch 20 the disk array I/F node 202 is connected for every port of the disk array subset 10 which 
disk array I/F21 connects. 

[0038] Specifically, it has Subset No. which specifies the disk array subset 10, Subset Port No. which 
pinpoints a port, Switch No. which specifies the disk array switch 20 linked to the port, and I/F Node No. 
which specifies the disk array I/F node 202 of the disk array switch 20. When the disk array subset 10 is 
equipped with two or more ports, information is set up for every port of the. 

[0039] A subset configuration table has two or more tables 202720-202723 corresponding to each disk 
a'rray subset 10, as shown in drawing 7 . Each table contains LU configuration table 202740 holding the 
. information which indicates the configuration of LU built in the disk array subset 10 to be the RAID group 
configuration table 202730 holding the information which shows a RAID group's configuration built within 
the disk array subset 10. 

[0040] In a configuration of that striping of the RAID level 0 and the 5 grades was carried out, Group No. 
which shows the number by which the RAID group configuration table 202730 was added to the RAID 
group, Level which shows the RAID groups level, Disks which is the information which shows the number 
of the disks which constitute the RAID group, and its RAID group contain as information Stripe Size which 
shows the stripe size. For example, in the table shown in drawing, a RAID group "0" is a RAID group 
constituted by four sets of disk units, RAID level is 5 and stripe size is SO. 

[0041] LU configuration table 202740 contains as information LU No. which shows the number (LUN) added 
to LU, RAID Group which shows whether this LU is constituted by which RAID group, Condition which 
shows the condition of LU, Size which shows the size (capacity) of this LU, Port which shows whether this 
LU is accessible from the port of disk array subset 10 throat, and AltPort which shows the port used as 
that alternative. The condition by which it is shown by Condition has four kinds, "Normal", "Warning", 
"Fault", and "Not Defined", like Condition about Host LU. When a failure occurs in the port pinpointed for 
the information set as Port, it is used, but the port pinpointed using the information set as AltPort can 
also be used in order to only access the same LU from two or more ports. 

[0042] Drawing 8 is the block diagram of the frame in a fiber channel. The frame 40 of a fiber channel 
contains CRC (Cyclic RedundancyCheck)403 which is an error detection code with a frame payload of 402 
or 32 bits which is the part which stores SOF (Start Of Frame)400, the frame header 401, and the actual 
condition data of a transfer in which the head of a frame is shown, and EOF (End Of Frame)404 which 
shows the tail end of a frame. The frame header 401 has structure as shown in drawing 9 , and ID (SEQJD) 
of a sequence which specifies the frame group under each exchange ID specified by a response place 
(OXJD, RXJD) and exchange is stored the ID [ of the frame source ] (SJD), ID [ of the frame destination ] 
(DJD), and starting origin of an exchange. 

[0043] With this operation gestalt, ID by which ID assigned to the host 30 as SJD was assigned as DJD to 
the port of the disk array switch 20 again is used for the frame published by the host 30. The exchange ID 
of one pair (OXJD, RXJD) is assigned to one host command. When it is necessary to publish two or more 
data frames to the same exchange, the same SEQJD is assigned to all the data frames, and each is 
identified at a sequence count (SEQ_CNT). The maximum length of the frame payload 402 is 2110 bytes, 
and the contents stored for every frame kind differ. For example, in the case of the FCP.CMD frame 
mentioned later, as shown in drawing 10 , SCSI Logical Unit Number (LUN), Command Description Block 
(CDB), etc. are stored. CDB contains a command cutting tool required for disk (disk array) access, the 
transfer initiation logical address (LBA), and transfer length (LEN). 

[0044] Hereafter, actuation of the disk array system of this operation gestalt is explained. 
[0045] Before using a disk array system, it is necessary to the disk array switch 20 to set up the 
configuration information of the disk array subset 10. A system administrator acquires all the disk array 
subsets 10 and the configuration setting information on the disk array switch 20 from an administration 
terminal 5 through the disk array system configuration means 70. A manager inputs setting information 
required for various setup, such as a configuration setup of Logical unit, a setup of RAID level, and a setup 
of the shift pass at the time of failure generating, so that it may become a desired system configuration 
from an administration terminal 5. The disk array system-configuration-control means 70 receives the 
setting information, and transmits setting information to each disk array subset 10 and the disk array 
switch 20. In addition, the 5th operation gestalt explains separately the input of the setting information in 
an administration terminal 5. 

[0046] With the disk array switch 20, the communication link controller 204 acquires setting information, 
and configuration information, such as address space information on each disk array subset 10, is set up by 
MP200. MP200 distributes the configuration information of the disk array subset 10 to each host I/F node 
203 and the disk array I/F node 202 by crossbar switch 201 course. 



[0047] Each nodes 203 and 202 store configuration information in DCT2027 by SP2021, if this information 
Is received. In the disk array subset 10 T the disk array subset configuration management means 106 
adquires setting information, and stores in a shared memory 102. Each high order MPU 1010 and low order 
MPU 1030 carry out each configuration management with reference to the setting information on a shared 
memory 102. 

[0048] Below, actuation when a host "#2" publishes a lead command to the disk array system 1 is 
explained. The flow chart of actuation [ in / for the mimetic diagram showing the sequence of the frame 
transmitted to drawing 1 1 through a fiber channel at the time of the lead actuation from a host / the host 
I/F node 203 of the disk array switch at this time ] is shown in drawing 13 . 

[0049] In addition, in the following explanation, a host "#2" assumes accessing the storage region A1001 in 
- drawing 1 2 . A " of actual storage regions corresponding to a storage region A1001 shall exist in the 
address space of disk unit #2 which constitute LU of LUN=0 of a disk array subset "#0." Moreover, "CLU" 
shall be set to LU Type of the host LU configuration table 20271 which defines LU which constitutes an 
address space 1000, and "Joined" shall be set to CLU Class. 

[0050] A host 30 publishes the command frame "FCP_CMD" which stored the lead command on the disk 
array switch 20 at the time of the lead of data ( drawing 1 1 arrow head (a)). The host I/F node "#2" of the 
disk array switch 20 receives a command frame "FCP_CMD" by host I/F31 course by IC2023 (step 20001). 
IC2023 transmits a command frame to SC2022. SC2022 once stores the received command frame in 
FB2025. Under the present circumstances, SC2022 calculates CRC of a command frame and inspects that 
receipt information is right If an error is in inspection of CRC, SC2022 will notify that to IC2023. IC2023 
will report a CRC error to a host 30 through host I/F31, if the notice of an error is received from SC2022. 
(Step 20002) . 

[0051] The frame to which CRC held SC2022 to FB2025 the right case is led, it recognizes that it is a 
command frame, and the frame header 401 is analyzed (step 20003). And SC2022 is directed to SP2021 
and registers exchange information, such as SJD, D_ID r and OXJD, into ET2026 (step 20004). 
[0052] Next, SC2022 analyzes the frame payload 402 and acquires LUN and CDB which were specified by 
the host 30 (step 20005). With directions of SC2022, SP2021 searches DCT2027 and gets the 
configuration information of the disk array subset 10. Specifically, SP2021 finds the information which has 
Host-LU No. which is in agreement with LUN stored in the frame payload 402 which searched the host LU 
configuration table 20271 and was received. SP2021 recognizes Host's LU configuration from the 
information set as LU Type and CLU Class, and distinguishes LUN of the disk subset 10 which should be 
accessed based on the information currently held at LU Info., and LU in it, and LBA within this LU. Next, 
with reference to LU configuration table 202740 of the subset configuration table 202720, SP2021 checks 
the connection port of the target disk array subset 10, and gets node No. of the disk array I/F node 202 
linked to the port from the disk array I/F node configuration table 20272. SP2021 reports the conversion 
information that the disk array subset 10 which carried out in this way and was obtained is identified, such 
as a number, and LUN, LBA, to SC2022. (Step 20006) . 

[0053] Next, SC2022 changes LBA in LUN and CDB of the frame payload 402 using the acquired 
conversion information. Moreover, DJD of the frame header 401 is changed into DJD of the corresponding 
host I/F controller 1011 of the disk array subset 10. In addition, SJD is not rewritten at this time (step 
20007). 

[0054] SC2022 transmits the disk array I/F node number linked to the command frame and the object disk 
array subset 10 after conversion to SPG2024. SPG2024 generates the packet which added the easy 
extended header 601 as shown in drawing 14 to the command frame after the received conversion. This 
packet is called the switching packet (S Packet) 60. S In the extended header 601 of Packet60, a source 
(self-node) number, a destination node number, and transfer length are ****** rare **. SPG2024 transmits 
generated S Packet60 to a crossbar switch 201 (step 20008). 

[0055] A crossbar switch 201 receives S Packet60 by SWP2010 linked to a host I/F node "#2." SWP2010 
performs switch control to SWP which the node of the destination connects with reference to the 
extended header 601 of S Packet60, establishes a path, and transmits S Packet60 to the disk array I/F 
node 202 (here disk array I/F node "#0") of the destination. SWP2010 will release the path, if it carries out 
at every reception of establishment of a path of S Packet60 and a transfer of S Packet60 is completed. In 
a disk array I/F node "#0" f SPG2024 receives S Packet60, removes the extended header 601, and passes 
the part of a command frame to SC2022. 

[0056] SC2022 writes its ID in SJD of the frame header of the received command frame. Next to SP2021, 
it points to SC2022 so that exchange information, such as SJD of a command frame, DJD, and OXJD, and 
a frame source host I/F node number may be registered into ET2026, and it transmits a command frame to 
IC2023. IC2023 transmits a command frame to the disk array subset 10 (here disk array subset "#0") to 
connect according to the information on the frame header 401 ( drawing 1 1 arrow head (b)). 



[0057] A disk array subset "#0" receives the command frame after conversion "FCP^CMD" by the disk 
array I/F. controller 1011. It is recognized as a high order MPU 1010 being a command which acquires LUN 
and CDB which were stored in the frame payload 402 of a command frame, and leads the data of LEN 
length from LBA of the specified Logical unit. 

[0058] A high order MPU 1010 performs cache hit mistake / hit judging with reference to the cache 
management information stored in the shared memory 102. If it hits, data transfer will be carried out from a 
cache 102. Since it is necessary to lead data from a disk unit in a mistake, address translation based on 
the configuration of RAID5 is carried out, and cache space is secured. And processing information required 
for lead processing from a disk unit 2 is generated, and processing information is stored in a shared 
memory 102 in order to take over processing to low order MPU 1030. 

. [0059] Low order MPU 1030 starts processing ignited by processing information having been stored in the 
shared memory 102. Low order MPU 1030 specifies the suitable disk I/F controller 1031, generates the 
lead command to a disk unit 2, and publishes a command for the disk I/F controller 1031. The disk I/F 

- controller 1031 stores the data led from the disk unit 2 in the address with which the cache 102 was 
specified, and notifies a termination report to low order MPU 1030. Low order MPU 1030 stores processing 
termination information in a shared memory 102 that it should notify that processing was completed 
correctly to a high order MPU 1010. 

[0060] A high order MPU 1010 resumes processing ignited by processing termination information having 
been stored in the shared memory 102, and notifies lead data-preparation completion to the disk array I/F 
controller 1011. The disk array I/F controller 1011 publishes ''FCP_XFERJRDY" which is a data transfer 
preparation-completion frame in a fiber channel to the disk array I/F node "#0" concerned of the disk 
array switch 20 ( drawing 1 1 arrow head (c)). 

[0061] In a disk array I/F node "#0", if a data transfer preparation-completion frame "FCP_XFER_RDY" is 
received, SC2022 will gain the response place exchange ID (RXJD) which received from the disk array 
subset 20, will specify SJD, DJD, and OXJD, will direct to SP2021, and will register RXJD into the 
exchange information concerned on ET2026. SC2022 gains the host I/F node number of the destination 
(source of a command frame) of a data transfer preparation-completion frame. SC2022 cancels SJD of this 
frame and transmits it to SPG2024. As SPG2024 was described previously, it generates S Packet, and it 
transmits it to a candidate host I/F node "#2" by crossbar switch 201 course. 

[0062] In a host I/F node "#2", if SPG2024 receives S Packet of a data transfer preparation-completion 
frame, the extended header of S Packet will be removed, "FCP_XFER_RDY" will be reproduced, and 
SC2022 will be passed (step 20011). SC2022 is directed to SP2021 and specifies the exchange which 
searchs ET2026 and corresponds (step 20012). 

[0063] Next, SG2022 investigates whether a frame is "FCP.XFERJRDY" (step 20013), and if it is 
"FCP_XFER_EDY", it will direct renewal of the response place exchange ID of ET2026 (RXJD) to SP2021. 
The value added to this frame is used as response place exchange ID (step 20014). And SC2022 changes 
SJD of the frame header 401, and DJD into the suitable value which used ID of the host I/F node 203, and 
a host's 30 ID (step 20015). The frame header 401 is changed into the frame to a host "#2" by these 
processings. IC2023 publishes this data transfer preparation-completion frame "FCP_XFER_RDY" to a host 
"#2" (the arrow head of drawing 1 1 (d): step 2001 6). 

[0064] In order that the disk array I/F controller 101 1 of a disk array subset "#0" may perform data 
transfer, it generates a data frame "FCPJDATA" and transmits it to the disk array switch 20 ( drawing 1 1 
arrow head (e)). Since the transfer length of a frame payload has a limit, the greatest data length which can 
be transmitted by one frame is 2KB. When a data length exceeds this, only a required number generates 
and publishes a data frame. The same SEQJD is assigned to all data frames. Issue of a data frame is the 
same as that of the case where it is a data transfer preparation-completion frame except for two or more 
frames being generated to the same SEQJD (that is, SEQJDNT changing). 

[0065] The disk array switch 20 changes the frame header 401 of a data frame "FCPJDATA" like 
processing of a data transfer preparation-completion frame. However, since RXJD is already established in 
the transfer of a data frame, processing of step 20014 in processing of a data transfer preparation- 
completion frame is skipped. The disk array switch 20 transmits a data frame to a host "#2" after 
conversion of the frame header 401 ( drawing 1 1 arrow head (f)). 

[0066] Next, in order that the disk array I/F controller 101 1 of a disk array subset "#0" may perform an 
exit-status transfer, it generates a status frame "FCPJRSP" and publishes it to the disk array switch 20 
( drawing 1 1 arrow head (g)). With the disk array switch 20, like processing of a data transfer preparation- 
completion frame, SPG2024 removes an extended header from S Packet, reproduces a "FCPJRSP" status 
frame (step 20021), searches ET2026 by SP2021, and acquires exchange information (step 20022). SC2022 
changes a frame based on the information (20023 of a step). The changed frame is transmitted to a host 
"#2" by IC2023 ( drawing 1 1 arrow head (h): step 20024). Finally SP2021 deletes exchange information 



from ET2026 (step 20025). 

[0067] Lead processing from a disk array is performed as mentioned above. Lead processing mentioned 
above only by the direction of transfer of a data frame being reversed also about the light processing to 
the. disk array system 1 and same processing are performed. 

[0068] As shown in drawing 3 , the disk array switch 20 equips the crossbar switch 201 with I/F2040 
between clusters. I/F2040 between clusters is not used in the system configuration shown in drawing 1 . 
The disk array switch 20 of this operation gestalt is mutually connectable with other disk array switches, as 
shown in drawing 1 5 using I/F2040 between clusters. 

[0069] the disk array switch 20 in this operation gestalt — although the disk array subset 10 is 
connectable only to a total of eight sets with a host 30 if independent, the number of disk arrays can be 
- increased with the host 10 who interconnects and can connect two or more disk array switches using 
I/F2040 between clusters. For example, in the system shown in drawing 1 5 , the disk array subset 10 can 
be connected to a total of 32 sets with a host 30 using four sets of the disk array switches 20, and data 
transfer becomes possible mutually among these. 

[0070] Thus, with this operation gestalt, the connection number of a disk array subset or a host can be 
increased according to the need for disk capacity or the engine performance. Moreover, since between 
host-disk array systems is connectable using host I/F for a required transfer band, the expandability of 
capacity, the engine performance, and the number of connection can be raised sharply. 
[0071] According to the operation gestalt explained above, even if the engine performance of one set of a 
disk array subset is restricted by internal MPU and an internal internal bus, it can interconnect between 
disk array subsets with a host with a disk array switch using two or more disk array subsets. Thereby, the 
engine performance high as a disk array system total is realizable. Even if the engine performance of a disk 
array subset is comparatively low, high performance-ization is realizable by using two or more disk array 
subsets. Therefore, according to the scale of a computer system, only the required number can connect 
the disk array subset of low cost, and it becomes possible to build a disk array system at the suitable cost 
according to a scale. 

[0072] Moreover, what is necessary is just to add a disk array subset as required when increase of disk 
capacity and improvement in the engine performance are needed. Furthermore, since the host and disk 
array subset of a number of arbitration are connectable using two or more disk array switches, both 
capacity the engine performance and the number of connection can be raised sharply, and the system 
which has high expandability can be realized. 

[0073] Since the contraction machine of the conventional disk array system itself can be used as a disk 
array subset according to this operation gestalt, the already developed large-scale control-software 
property can be used as it is, and reduction of development cost and compaction of a development cycle 
can be realized further again. 

[0074] [2nd operation gestalt] drawing 1 6 is the block diagram of the computer system in the 2nd operation 
gestalt of this invention. This operation gestalt changes only the frame header 401 in the host l/F node of 
a disk array switch, and the frame payload 402 is different from the 1st operation gestalt constitutionally at 
the point which the point which is not operated and a disk array switch, host I/F, and disk array I/F have 
not doubled. Therefore, the configuration of each part does not have the 1st operation gestalt and the 
place which changes a lot, and omits explanation about the detail. 

[0075] In drawing 16 , each disk array subset 10 consists of two or more Logical unit (LU) 110. Each LU110 
is constituted as an independent LU. Generally, LUN assigned to LU110 in each disk array subset 10 is the 
consecutive number which begins from 0. For this reason, to show continuously LUN of all LUs110 in the 
disk array system 1 to a host 30, it is necessary to change the LUN field of the frame payload 402 like the 
1st operation gestalt. With this operation gestalt, by showing a host 30 LUN of each disk array subset 10 
as it is, conversion of the frame payload 402 is made unnecessary and control of a disk array switch is 
made easy. 

[0076] The disk array switch 20 of this operation gestalt is assumed to be what can access the specific 
disk array subset 10 every host I/F node 203. In this case, if one host I/F31 is used, only LU1 10 in one set 
of the disk array subset 10 is accessible. The host is connected to two or more host I/F nodes 203 to 
access LU110 of two or more disk array subsets 10 from one set of a host. Moreover, when enabling it to 
access LU110 of one set of the disk array subset 10 from two or more hosts 30, loop-formation topology, 
fabric topology, etc. are used for the same host I/F node 203, and two or more hosts 30 are connected. 
Thus, since the disk array subset 10 will be decided for every DJD of the host I/F node 203 in case one 
LU1 10 is accessed from one set of a host 30 if constituted, it is possible to show a host 30 LUN of each 
LU as it is. 

[0077] With this operation gestalt, for the reason mentioned above, since LUN of LU110 in each disk array 
subset 10 is shown to the host 30 as it is at the host 30, conversion of LUN in the disk array switch 20 



becomes unnecessary. For this reason, the disk array switch 20 will change only the frame header 401 like 
the 1st example, if a frame is received from a host 30, and it transmits the frame payload 402 to the disk 
array subset 10, without changing. Since actuation of each part in this operation gestalt is the same as that 
of the 1st operation gestalt if it removes that conversion of the frame payload 402 is not performed, 
detailed explanation is omitted here. According to this operation gestalt, development of the disk array 
switch 20 can be made easy. 

[0078] With the 2nd operation gestalt of the [3rd operation gestalt], in the host I/F node of a disk array 
switch, although only the frame header is changed, by the 3rd operation gestalt explained below, the gestalt 
which does not change a frame is explained also including a frame header. The computer system of this 
Operation gestalt is constituted like the computer system in the 1st operation gestalt shown in drawing 1 . 
. [0079] With the 1st and 2nd operation gestalt, internal configurations of the disk array system 1, such as 
the number of the disk array subset 10 and a configuration of LU110, are concealed to a host 30. For this 
reason, from a host 30, the disk array system 1 appears as one storage on the whole. On the other hand, 
the disk array subset 10 is opened to a host 30 as it is, and a host 30 enables it to use ID of the port of a 
direct disk array subset as DJD of a frame header with this operation gestalt Thereby, a disk array switch 
just needs to control a transfer of a frame according to the information on a frame header, and can change 
and use switching equipment equivalent to the fabric equipment of the fiber channel in the conventional 
technique for the disk array switch 20. 

[0080] The disk array system-configuration-control means 70 communicates with the means of 
communications 204 of the communication link controller 106 of the disk array subset 10, and the disk 
array switch 20, and gains or sets up the configuration information of each disk array subset 10 and the 
disk array switch 20. 

[0081] The disk array switch 20 has fundamentally the same configuration as the disk array switch in the 
1st operation gestalt shown in drawing 3 . However, in order to control a transfer of a frame by this 
operation gestalt, using the information on the frame header of the frame which a host 30 publishes as it is, 
the function of conversion, such as DCT2027 which the host I/F node 203 of the disk array switch 20 and 
the disk array I/F node 202 have with the 1st operation gestalt or the 2nd operation gestalt, and a frame 
header realized by SC2022 and SPG2024 grade, becomes unnecessary. The crossbar switch 201 which the 
disk array switch 20 has transmits the frame of a fiber channel according to the information on a frame 
header between the host I/F node 203 and the disk array I/F node 202. 

[0082] With this operation gestalt, in order to manage the disk array structure of a system collectively with 
the disk array system-configuration-control means 70, the disk array system-configuration-control means 
70 is equipped with a disk array administrative table (this table is also hereafter called DOT). DOT with 
which the disk array system-configuration-control means 70 is equipped contains two table groups, the 
system configuration table 20270 shown in drawing 6 and 7, and the subset configuration tables 202720- 
202723. In addition, with this operation gestalt, since Host LU is altogether constituted as ILU, all LU Type 
(s) of the host LU configuration table 20271 serve as "ILU", and CLU Class and CLU Stripe Size do not 
make semantics. 

[0083] A manager operates an administration terminal 5, communicates with the disk array system- 
configuration-control means 70, acquires information, such as disk capacity of the disk array subset 10, 
and the number of a disk unit, and performs a setup of LU1 10 of the disk array subset 10, a setup of RAID 
level, etc. Next, a manager communicates with the disk array system-configuration-control means 70 with 
an administration terminal 5, controls the disk array switch 20, and sets up the related information between 
the disk array subsets 20 with each host 30. 

[0084] LU110 can come to be seen as the configuration of the disk array system 1 is established and a 
manager wishes from a host 30 by the above actuation. The disk array configuration management means 70 
can save the above setting information, and according to the actuation from a manager, the check of a 
configuration is performed and it can make a change of a configuration. 

[0085] Once it constitutes the disk array system 1 according to this operation gestalt, existence of the 
disk array switch 20 cannot be made to be able to recognize from a manager, and two or more disk array 
subsystems can be treated like one set of a disk array system. Moreover, according to this operation 
gestalt, the disk array switch 20 and the disk array subset 10 can be systematically operated according to 
the same operating environment, and the configuration check and a configuration change also become 
easy. Furthermore, without changing a setup of a host 30, when transposing the disk array system which 
was being used conventionally to the disk array system in this operation gestalt according to this operation 
gestalt it can double with the disk array structure of a system which was using the configuration of the 
disk array system 1 till then, and compatibility can be maintained. 

[0086] With the 1st to 3rd operation gestalt explained beyond the [4th operation gestalt], the fiber channel 
is used for host I/F. The operation gestalt explained below explains the gestalt in which interfaces other 



than a fiber channel were intermingled. 

[0087] Drawing 17 shows the example of 1 configuration of IC2023 of the host I/F node 203 interior in 
case host I/F is Parallel SCSI. The SCSI protocol controller (SPC) by which 20230 performs protocol 
control of Parallel SCSI, the fiber channel protocol controller (FPC) by which 20233 performs protocol 
control of a fiber channel, the protocol conversion processor (PEP) to which 20231 carries out protocol 
conversion of Serial SCSI of a fiber channel to Parallel SCSI, and 20232 are buffers (BUF) which save the 
data in protocol conversion temporarily. 

[0088] In this operation gestalt, a host 30 publishes the SCSI command to the disk array I/F node 203. In 
the case of a lead command, SPC20230 stores this in BUF20232, and reports reception of a command to 
PEP20231 by interruption. PEP20231 uses the command stored in BUF20232, changes it into the command 
to FPC20233, and is sent to FPC20233. If this command is received, FPC20233 will be changed into a 
frame format and will be handed over to SC2022. Under the present circumstances. Exchange ID, 
Sequence ID, Source ID, and Destination ID are added by PEP20231 so that subsequent processings may 
be possible. Next command processing is performed like the 1st operation gestalt 
[0089] The disk array subset 10 will carry out issue of issue of a data transfer preparation-completion 
frame, data transfer, and the status frame after normal termination, if preparation of data is completed. 
While the frame header 401 and the frame payload 402 are changed if needed, a transfer of various frames 
is performed from the disk array subset 10 before IC2023. FPC20233 of IC2023 receives a data transfer 
preparation-completion frame, it receives data continuously, stores them in BUF20232, and if a transfer 
finishes normally continuously, it will report data transfer completion, it receiving a status frame and 
applying interruption to PTP20231. If interruption is received, PTP20231 starts SPC20230 and directs that 
it starts data transfer to a host 30. If SPC20230 transmits data to a host 30 and normal termination is 
checked, it will report normal termination by interruption to PTP20231. 

[0090] Here, although Parallel SCSI was shown as an example of host I/F other than a fiber channel, it is 
possible to apply similarly to ESCON which are other interfaces, for example, host I/F to a mainframe. It is 
possible to make both so-called open systems, such as a mainframe, and a personal computer, a 
workstation, intermingled in one set of the disk array system 1, and to connect with it by preparing for 
example, a fiber channel and the host I/F node corresponding to Parallel SCSI and ESCON as a host I/F 
node 203 of the disk array switch 20. Although the fiber channel is used like the 1st to 3rd operation 
gestalt as disk array I/F with this operation gestalt, it is possible to use I/F of arbitration also to disk array 
I/F. 

[0091] The approach of the configuration management of the [5th operation gestalt], next the disk array 
system 1 is explained as the 5th operation gestalt. Drawing 1 8 is the system configuration Fig. of this 
operation gestalt. With this operation gestalt, the host 30 is formed four sets. I/F30 between the disk array 
systems 1 is connected with a host "#0" and "#1" by Parallel SCSI (Ultra2 SCSI) between the fiber 
channel, the host "#2", and the disk array system 1 between Parallel SCSI (Ultra SCSI), and a host "#3" 
and the disk array system 1. 

[0092] Connection with the disk array switch 20 of Parallel SCSI is made like the 4th operation gestalt The 
disk array system 1 has four sets of the disk array subsets 30. Two independent LUs are constituted by 
four independent LUs and the disk array subset "#1" at the disk array subset "#0", respectively. One 
integration LU consists of a disk array subset "#2" and "#3." With this operation gestalt, like the 1st 
operation gestalt, the disk array subset 10 shall be concealed to a host 30, and the frame of a fiber channel 
shall be changed. LUN assigned to each LU — the order from LU of a disk array subset "#0" — LUN=0, 1 
and 2, and ... they are 7 **s to 6. 

[0093] Drawing 19 is an example of the screen displayed on the display screen of an administration 
terminal 5. Drawing is the logical connection configuration screen in which correspondence with host I/F31 
and each Logical unit (LU) was shown. 

[0094] The relation between the information 3100 about each host I/F31, the information 11000 about 
each LU110, the disk array subset 10, and LU110 etc. is displayed on the logical connection configuration 
screen 50. An I/F class, an I/F rate, the status, etc. are contained as information about host I/F31. As 
information about LU110, a storing subset number, LUN, capacity, RAID level, the status, information, etc. 
are displayed. By referring to this screen, a manager can manage the configuration of the disk array system 
1 easily. 

[0095] On the logical connection configuration screen 50, the line currently drawn between host I/F and 
LU shows accessible LU1 10 via each host I/F31. It cannot access from the host 30 who connects with the 
host I/F from host I/F to LU110 by which a line is not drawn. Since the data format to treat differs and a 
user also changes with hosts 30, it is indispensable on security maintenance to prepare a suitable access 
restriction. Then, the manager who sets up a system carries out access restriction by whether the access 
permission between each LU110 and host I/F is given using this screen. In drawing, although LU "#0" is 



accessible from host I/F "#0" and "#1", it cannot be accessed from host I/F "#2" and "#3." LU "#4" is 
accessible only from host I/F "#2." 

[0096] In. order to realize such an access restriction, access-restriction information is transmitted from the 
disk array system-configuration-control means 70 to the disk array switch 20. The access-restriction 
information sent to the disk array switch 20 is distributed to each host I/F node 203, and is registered into 
DCT2027 of each host I/F node 203. When the inspection command of LU existence existence to LU to 
which access was restricted is published by the host, it is each host I/F node's 203 inspecting DCT2027, 
and not answering to an inspection command, or returning an error, and the LU is no longer recognized 
from a host by him. In the case of a SCSI protocol, generally as an inspection command of LU existence 
existence, the Test Unit Ready command and the Inquiry command are used. Since read/write is not 
« carried out without this inspection, it is possible to apply a limit of access easily. 
[0097] Although access restriction is applied every host I/F31 with this operation gestalt, it is also easily 
realizable by extending this to apply access restriction every host 30. Moreover, host I/F31, a host 30, or 
an address space can be pinpointed, and the access restriction according to the classification of a 
command to which only the lead was told as good and which good, read/write, and good and read/write 
told that only a light was improper can also be applied. In this case, a host I/F number, Host ID, an address 
space, a limit command, etc. are specified as access-restriction information, and a limit is set as the disk 
array switch 20. 

[0098] Next, the addition of the new disk array subset 10 is explained. When adding the disk array subset 
10 newly, a manager connects the disk array subset 10 added to the disk array I/F node 202 as for which 
the disk array switch 20 is vacant. Continuously, a manager operates an administration terminal 5 and does 
the depression of the carbon button 5001 "reflecting the newest condition" currently displayed on the 
logical connection configuration screen 50. This actuation is answered and the picture showing a non-set 
up disk array subset is displayed on a screen (not shown). If it carries out by choosing the picture of this 
disk array subset, the setting screen of a disk array subset will appear. A manager carries out various 
setup of the disk array subset added newly on the displayed setting screen. There are a configuration of 
LU, RAID level, etc. in the item set up here. Continuously, if it changes to the screen of the logical 
connection block diagram of drawing 1 9 , a new disk array subset and LU will appear. Henceforth, if the 
access restriction which receives every host I/F31 is set up and the depression of the "setting activation" 
carbon button 5002 is carried out, to the disk array switch 20, the information on access-restriction 
information and a disk array subset, and LU will be transmitted, and a setup will be performed. 
[0099] It is performed by the procedure which also mentioned above the procedure at the time of adding 
LU1 10 to each disk array subset 10. Moreover, it is performed by a disk array subset and the procedure 
with the same almost said of deletion of LU. A different point is a point performed, after a manager 
chooses each deletion part on a screen, and pushes "deletion" carbon button 5003 and a suitable check is 
performed. As mentioned above, a manager can manage the whole disk array system unitary by using an 
administration terminal 70. 

[0100] Processing of the [6th operation gestalt], next mirroring by the disk array switch 20 is explained as 
the 6th operation gestalt. Mirroring explained here is the approach of supporting duplex writing by two 
independent LUs of two sets of disk array subsets, and is the doubleness which even the controller of a 
disk array subset included. Therefore, dependability differs from doubleness of only a disk. 
[0101] The structure of a system in this operation gestalt is the same as what is shown in drawing 1 . the 
configuration shown in drawing 1 — it shall be, a disk array subset "#0" and "#1" shall completely be 
equipped with the same LU configuration, and these two disk array subsets shall be seen as one disk array 
from a host 30 For convenience, the number of the pair of the disk array subset by which mirroring was 
carried out is called "#01." Moreover, a mirroring pair is formed of LU "#0" and LU "#1" of each disk array 
subset, and the pair of this LU is called LU "#01" for convenience by them. "Mirrored" is set as CLU Class 
and, as for the information for managing LU#01 on the host LU configuration table 20271 of DCT2027, the 
information about LU#0 and LU#1 is set up as LU Tnfo. The configuration of other each part is the same as 
that of the 1st operation gestalt 

[0102] Actuation of each part in this operation gestalt is the same as that of the 1st example almost. 
Hereafter, the point which is different from the 1st operation gestalt is explained focusing on actuation of 
the host I/F node 203 of the disk array switch 20. The mimetic diagram showing the sequence of the frame 
to which drawing 20 is transmitted at the time of the light actuation in this operation gestalt, drawing 21 , 
and 22 are flow charts which show the flow of processing by the host I/F node 203 at the time of light 
actuation. 

[0103] The light command frame (FCP_CMD) which the host 30 published is received by IC2023 at the time 
of light actuation (the arrow head of drawing 20 (a): step 21001). The light command frame received by 
IC2023 is step 20002 at the time of the lead actuation explained with the 1st operation gestalt. It is 



processed like 20005 (step 21002-21005). 

[0104] SC2022 searches DCT2027 using SP2021, and recognizes that it is a light access request to LU 
"#01" of the mirror-ized disk array subset "#01" (step 21006). SC2022 creates the duplicate of the 
command frame which received on FB2025 (step 21007). SC2022 changes a command frame based on the 
configuration information set as DCT2027, and creates the separate command frame of both LU "#0" and 
LU "#1" (step 21008). Here, main LU and LU"#1" is called a main command frame and ** command frame 
for LU "#0" also to ** LU, a call, and a command frame, respectively, and both — exchange information is 
separately stored in ET2026, and the command frame created to the disk array subset "#0" and the disk 
array subset "#1" is published (the arrow head of drawing 20 (bO) (b1): step 21009). 

[01 05] Each disk array subset "#0" and "#1" receive a command frame, and they transmit a data transfer 
. preparation-completion frame (FCP.XFER.RDY) to the disk array switch 20 independently, respectively 
(arrow head of drawing 20 (cO) (cD). Step 2001 1 of lead actuation [ in / by the disk array switch 20 / in 
the host I/F node 203 / the 1st operation gestalt ] The data transfer preparation-completion frame 
• transmitted by the same processing as 20013 is processed (step 2101 1-21013). 
[0106] In the phase which had complete set of data transfer preparation-completion frame from each disk 
array subset (step 21014) and SC2022 carry out conversion to the main data transfer preparation- 
completion frame (step 21015), and transmit the frame after conversion to a host 30 by IC2023 (the arrow 
head of drawing 20 (d): step 21015). 

[0107] A host 30 transmits a data frame (FCP.DATA) to the disk array switch 20 for light data 
transmission, after receiving a data transfer preparation-completion frame (arrow head of drawing 20 (e)). If 
the data frame from a host 30 is received by IC2023 (step 21031), like a lead command frame or a light 
command frame, it will be stored in FB2025 and CRC inspection and analysis of a frame header will be 
performed (steps 21032 and 21033). Based on the analysis result of a frame header, ET2026 is searched by 
SP2021 and exchange information is acquired (step 21034). 

[0108] SC2022 creates a duplicate like the time of a light command frame (step 21035), one of these is 
turned to LU "#0" in a disk array subset "#0", and turns another side to LU "#1" in a disk array subset 
"#1", and transmits (the arrow head of drawing 20 (fO) (f1): step 21037). 

[0109] A disk array subset "#0" and "#1" receive a data frame, it carries out a light to a disk unit 104, 
respectively, and they transmit a status frame (FCP.RSP) to the disk array switch 20. 
[0110] SC2022 — a disk array subset "#0" and "#1" — respectively — since — if a status frame is 
received, an extended header will be removed from those status frames, a frame header will be reproduced, 
and exchange information will be acquired from ET2026 (steps 21041 and 21042). 

[0111] If the status frame from both disk array subset "#0" and "#1" gathers (step 21043), conversion to 
the main status frame from LU "#0" will be performed after a check of that the status is normal 
termination (step 21044), and ** status frame elimination will be carried out (step 21045). And IC2023 
transmits the command frame for reporting normal termination to a host (the arrow head of drawing 20 (h): 
step 21046). Finally SP2021 eliminates the exchange information on ET2026 (step 21047). 
[01 12] The light processing in a mirroring configuration is completed above. Although lead processing to LU 
"#01" by which mirroring was carried out is performed almost like the light processing which the directions 
of a data transfer only differ and was mentioned above, unlike a light, it does not need to publish a lead 
command to two sets of disk array subsets, and should just publish a command frame to either. For 
example, because of improvement in the speed, although a command frame may always be published to the 
main LU, if a load is distributed by publishing a command frame by turns etc. to LU of the Lord/******, it 
is effective. 

[01 13] In the processing mentioned above, a synchronization of waiting and both is taken for the response 
of two sets "#0" of disk array subsets, and "#1" at step 21014 and step 21043, and processing is 
advanced. In such control, after a success of processing by both disk array subsets is checked, in order 
that processing may progress, the correspondence at the time of error generating becomes easy. On the 
other hand, in order that the whole processing speed may be dependent on the response of which or the 
later one, there is a fault that the engine performance falls. 

[01 14] Since this problem is solved, when it progresses to the next processing, without waiting for the 
response of a disk array subset or there is a response from one of the disk array subsets, in a disk array 
switch, it is also possible to carry out "asynchronous" control which progresses to the next processing. In 
drawing 20 , a broken-line arrow head shows an example of the frame sequence at the time of performing 
asynchronous control. 

[01 15] [n the frame sequence shown by the broken-line arrow head, transmission of the data transfer 
preparation-completion frame to the host to whom it is carried out at step 21016 is carried out after 
processing of step 21009, without waiting for the data transfer preparation-completion frame from the disk 
array subset 10. In this case, the data transfer preparation-completion frame transmitted to a host is 



generated by SC2022 of the disk array switch 20 (broken-line arrow head (d*)). 

[01 16] From a host 30, a data frame is transmitted to the disk array switch 20 to the timing shown by the 
broken-line arrow head (e*X With the disk array switch 20, this data frame is once stored in FB2025. 
SC2022 answers reception of the data transfer preparation-completion frame from the disk array subset 
10, and transmits the data frame held at FB2025 to the disk array subset 10 to which the data transfer 
preparation-completion frame has been sent (a broken-line arrow head (fD*), (fV)). 
[0117] The termination report to a host 30 from the disk array switch 20 is performed when there is a 
report (a broken-line arrow head (g00, (g0*)) from both disk array subsystems 10 (broken-line arrow head 
(IV)). It is possible only for the part of the time amount Ta shown in drawing 20 to shorten the processing 
time by such processing. 

- [0118] The following processings are carried out when an error occurs in the middle of the frame transfer 
between the disk array switch 20 and the disk array subset 10. 

[0119] When the processing under activation is light processing, retry processing is performed to LU which 
" the error generated. If a retry is successful, processing will be continued as it is. When the retry of the 
count of the convention set up beforehand goes wrong, the disk array switch 20 forbids access to this disk 
array subset 10 (or LU), and registers into DCT2027 the information which shows that Moreover, the disk 
array switch 20 notifies that to the disc system configuration means 70 via MP200 and the communication 
link controller 204. 

[0120] The disc system configuration means 70 answers this notice, and publishes an alarm to an 
administration terminal 5. Thereby, a manager can recognize that the trouble occurred. Then, the disk array 
switch 20 continues operation using a normal disk array subset A host 30 does not recognize that the 
error occurred and can continue processing. 

[0121] raising the failure-proof nature of a disk, since a mirror configuration is realizable with two sets of 
disk array subsystems according to this operation gestalt — things are made. Moreover, a disk array 
controller, disk array l/F, and the failure-proof nature of a disk array I/F node can be raised, there is 
nothing with ** which carries out doubleness of an internal bus etc., and the dependability of the whole 
disk array system can be raised. 

[0122] Three or more sets of the [7th operation gestalt], next the disk array subsets 10 are unified, and 
how to constitute the group of one set of a logical disk array subset is explained. Data are distributed and 
stored in two or more disk array subsets 10 with this operation gestalt Thereby, access to a disk array 
subset is distributed and a total throughput is raised by inhibiting concentration of access to a specific disk 
array subset With this operation gestalt, such striping processing is carried out with a disk array switch. 
[0123] Drawing 23 is the address map of the disk array system 1 in this operation gestalt. Striping of the 
address space of the disk array subset 10 is carried out in the SUTOREIPU size S. The address space of 
the disk array system 1 seen from the host is distributed by every stripe size S a disk array subset "#0", 
"#1", "#2", and "#3." Although the size of the stripe size S is arbitrary, the direction which is not not 
much small is good. When the stripe size S was too small and the stripe crossover to which the data which 
should be accessed belong to two or more stripes occurs, a possibility that an overhead may occur is in 
the processing. If stripe size S is enlarged, since the probability for a stripe crossover to occur will 
decrease, for the improvement in the engine performance, it is desirable. The number of LUs can be set as 
arbitration. 

[0124] Hereafter, actuation of the host I/F node 203 in this operation gestalt is explained and explained 
paying attention to difference with the 1st operation gestalt, referring to the operation flow chart shown in 
drawing 24 . In addition, with this operation gestalt, "Striped" is set to CLU Glass of the information about 
the host LU by whom striping was done on the host LU configuration table 20271 of DCT2027, and stripe 
size "S" is set to CLU Stripe Size. 

[0125] If a host 30 publishes a command frame, the disk array switch 20 will recognize that SC2022 which 
receives this (step 22001) needs to search DGT2027, and needs to carry out striping of this command 
frame using reception and SP2021 from IC2023 by IC2023 of the host I/F node 203 (step 22005). 
[0126] Next, SC2022 searches DCT2027 by SP2021, asks for the stripe number of the stripe with which 
the data set as the object of access belong from the configuration information containing the stripe size S, 
and specifies in which disk array subset 10 this stripe is stored (step 22006). Under the present 
circumstances, although a stripe crossover may occur, about the processing in this case, it mentions later. 
When a stripe crossover does not occur, based on SP's2021 count result, SC2022 changes to a command 
frame (step 22007), and stores exchange information in ET2026 (step 22008). Henceforth, the same 
processing as the 1st operation gestalt is performed. 

[0127] When a stripe crossover occurs, SP2021 generates two command frames. This generation is 
performed with reproducing the command frame which the host 30 published. The frame header of the 
command frame to generate, a frame payload, etc. are set up newly. Although it is also possible like the 6th 



operation gestalt to carry out conversion after creating the duplicate of a command frame by SC2022, it 
•shall b,e newly created by SP2021 here. SC2022 will transmit these to each disk array subset 10, if two 
command frames are generated. 

[0128] Then, data transfer is carried out like the 1st operation gestalt Here, unlike the 1st operation 
gestalt or the 6th operation gestalt, it is necessary to transmit the data itself with this operation gestalt in 
one set of the two sets of a host 30 and the disk array subsets 10. For example, in lead processing, it is 
necessary to transmit all the data frames transmitted from two sets of the disk array subsets 10 to a host 
30. Under the present circumstances, to the data frame transmitted from each disk array subset 10, 
according to the exchange information registered into ET2026, SC2022 is suitable sequence, adds suitable 
exchange information and transmits to a host 30. 

. [0129] In light processing, it transmits to the disk array subset 10 which divides and corresponds to two 
data frames like the case of a command frame. In addition, the sequence control of a data frame is not 
indispensable if the host or the disk array subset supports the processing in random order called an 

- AUTOOBU order (Out of Order) function. 

[0130] If all data transfer is completed and the disk array switch 20 finally receives two status frames from 
the disk array subset 10, SP2021 (or SC2022) will create the status frame to a host 30, and will transmit 
this to a host 30 by IC2023. 

[0131] Since access can be distributed to two or more disk array subsets, while being able to raise a 
throughput as total according to this operation gestalt, also as for an access latency, it is possible to make 
it decrease on the average. 

[0132] Creation of the duplicate for two sets (or disk array subset) of the [8th operation gestalt], next disk 
array systems is explained as the 8th operation gestalt. A system which is explained here arranges one 
side of two sets of disk array systems to a remote place, and is equipped with the resistance over the 
failure of the disk array system of another side by a natural disaster etc. The thing of creation of the 
duplicate performed between a disaster recovery, and a call and the disk array system of a remote place in 
a cure to such a disaster is called a remote copy. 

[0133] Since mirroring explained with the 6th operation gestalt constitutes a mirror from the disk array 
subset 10 installed in the geographical almost same location, disk array I/F21 is good by the fiber channel. 
However, when the disk array (disk array subset) which performs a remote copy is installed in the remote 
place exceeding 10km, you cannot transmit a frame without junction by the fiber channel. Since [ this ] the 
distance between each other is usually set to hundreds of km or more when used for a disaster recovery, it 
is impossible practically to connect between disk arrays by the fiber channel, and a high-speed public line, 
satellite communication, etc. by ATM (Asynchronous Transfer Mode) etc. are used 

[0134] Drawing 25 is an example of the disaster recovery structure of a system in this operation gestalt. 
[0135] 81 is Site A, 82 is Site B, and both sites are installed in a geographical remote place. 9 is a public 
line and an ATM packet passes through this. A site A81 and a site B82 have the disk array system 1, 
respectively. Here a site A81 is a common site usually used, and a site B82 is a remote disaster recovery 
site used when a site A81 is downed with disaster etc. 

[0136] The contents of the disk array subset "#0" of the disk array system 10 of a site A81 and "#1" are 
copied to the disk array subset for a remote copy of the disk array system 10 of a site B82 "#0", and 
"#1." What is connected to a remote site among the I/F nodes of the disk array switch 20 is connected to 
the public line 9 using ATM. This node is called the ATM node 205. The ATM node 205 is constituted like 
the host I/F node shown in drawing 5 , and IC2023 changes an ATM-fiber channel. This conversion is 
realized by the same approach as conversion of the SCSI—fiber channel in the 4th operation gestalt. 
[0137] Processing of the remote copy in this operation gestalt is similar with processing of mirroring in the 
6th operation gestalt Hereafter, a different point from processing of mirroring in the 6th operation gestalt 
is explained. 

[0138] If a host 30 publishes a light command frame, the disk array system 10 of a site A81 will double a 
frame like the case in the 6th operation gestalt, and will transmit one of these to the own disk array subset 
10. The frame of another side is changed into an ATM packet from a fiber channel frame by the ATM node 
205, and is sent to a site B82 through a public line 9. 

[0139] To a site B82, the ATM node 205 of the disk array switch 20 receives this packet. IC2023 of the 
ATM node 205 reproduces a fiber channel frame from an ATM packet, and transmits it to SC2022. SC2022 
performs frame conversion like the time of receiving a light command from a host 30, and transmits it to 
the disk array subset for a remote copy. Henceforth, in data transfer preparation-completion frames, data 
frames, and all the status frames, a remote copy is realizable by performing fiber channel-ATM conversion 
in the ATM node 205, and carrying out same frame transfer processing. 

[0140] When a host 30 publishes a lead command frame, the disk array switch 20 transmits a command 
frame only to the disk array subset 10 of a self-site, and leads data only from the disk array subset 10 of a 



self-site. The actuation at this time becomes the same as that of the 1st operation gestalt. 
[0141] According to this operation gestalt, user data can be backed up on real time and it can have the 
resistance over the site failure by a natural disaster etc., and disk array system failure. 
[0142] Integration of two or more LUs included by one set of the [9th operation gestalt], next the disk 
array subset 10 is explained. For example, in order that the disk unit for main frames may maintain 
compatibility with the past system, the maximum of the size of a logical volume is set as 2GB. When 
sharing such a disk array system also with an open system, LU will receive a limit of logical volume size as 
it is, and many its LUs of small size can be seen from a host. By such approach, when large capacity- 
ization progresses, the problem that employment becomes difficult arises. Then, it considers unifying this 
logical volume (namely, LU) and constituting one big integration LU by the function of the disk array switch 
- 20. In this operation gestalt, integration LU is created with the disk array switch 20. 
[0143] Integration of LU in this operation gestalt is the same as that of creation of the integration LU by 
two or more disk array subsets 10 which can be set in the 1st operation gestalt. Difference is only 
integration by the plurality LU in the same disk array subset 10. The actuation as a disk array system 
becomes completely the same as that of the 1st operation gestalt. 

[0144] Thus, by unifying two or more LUs included by the same disk array subset 10, and creating one big 
LU, it becomes unnecessary to manage many LUs from a host, and excels in operability, and the disk array 
system which reduced management cost can be built. 

[0145] The setting approach of the [10th operation gestalt], next the shift pass by the disk array switch 10 
is explained referring to drawing 26 . 

[0146] The configuration of each part in the computing system shown in drawing 26 is the same as that of 
the 1st operation gestalt Here, if two sets of hosts 30 access the disk array subset 10 using respectively 
different disk array I/F21, it will be assumed that it constitutes like. By a diagram, only the number which 
needs the host I/F node 203 and the disk array I/F node 202 of a disk array subset and the disk array 
switch 20 for explanation here is shown. 

[0147] The disk array subset 10 had the same configuration as drawing 2 , and has connected two disk 
array I/F controllers to one set of the disk array switch 20, respectively. The shift pass of disk array I/F21 
is set to DCT227 of each node of the disk array switch 20. Shift pass is pass of the alternative established 
so that it may become accessible, also when a failure occurs on one certain pass. Here, the shift pass of 
disk array I/F "#1 " and disk array I/F "#1" is set for the shift pass of disk array I/F "#0" as disk array I/F 
"#0." Similarly, shift pass is set also about each between the high order adapters in the disk array subset 
10, between a cache and alternate memory, and between low order adapters. 

[0148] Next, as shown in drawing 26 , disk array I/F21 linked to the high order adapter "#1" of the disk 
array subset 1 is disconnected, it assumes that the failure occurred, and the setting-operation of shift 
pass is explained. It becomes impossible for the host "#1" using disk array I/F21 which the failure 
generated to access the disk array subset 10 at this time. It is recognized as the failure having generated 
the disk array switch 20 on this pass, when not recovering, even if it detected the abnormalities of the 
frame transfer between the disk array subsets 10 and carried out retry processing. 
[0149] If the failure of pass occurs, SP2021 will register that the failure occurred in disk array I/F "#1" 
into DCT2027, and will register using disk array I/F "#0" as shift pass. Henceforth, SC2022 of the host I/F 
node 203 operates so that the frame from a host "#1" may be transmitted to the disk array I/F node 202 
linked to disk array I/F "#0." 

[0150] The high order adapter 101 of the disk array subset 10 succeeds and processes the command from 
a host ."#1." Moreover, the disk array switch 20 notifies generating of a failure to the disk array system- 
configuration-control means 70, and generating of a failure is notified to a manager by the disk array 
system-configuration-control means 70. 

[0151] According to this operation gestalt, a change on the shift pass at the time of a failure occurring on 
pass can be performed without making it recognize to a host side, and a shift processing setup by the side 
of a host can be made unnecessary. Thereby, the availability of a system can be raised. 
[0152] Each operation gestalt explained above explained the disk array system which used the disk unit 
altogether as storage media. However, this invention is not limited to this, and when not only a disk unit but 
an optical disk unit, a tape unit, DVD equipment, a semiconductor memory, etc. are used as storage media, 
it can be applied similarly. 
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* DESCRIPTION OF DRAWINGS 



- [Brief Description of the Drawings] 

rDrawing 11 It is the block diagram of the computer system of the 1st operation gestalt. 

rDrawing 2] It is the block diagram of the disk array subset of the 1st operation gestalt. 

[Drawing 3] It is the block diagram of the disk array switch of the 1st operation gestalt 

[Drawing 4] It is the block diagram of the crossbar switch of the disk array switch in the 1st operation 

gestalt 

[Drawing 5] It is the block diagram of the host I/F node of the disk array switch in the 1st operation 
gestalt 

FD rawing 6] It is the block diagram of a system configuration table. 
[Drawing 7] It is the block diagram of a subset configuration table. 
[Drawing 8 ] It is the block diagram of the frame of a fiber channel. 
[Drawing 9] It is the block diagram of the frame header of a fiber channel. 
[Drawing 10] It is the block diagram of the frame payload of a fiber channel. 

[Drawing 11] It is the mimetic diagram showing the sequence of the frame transmitted through a fiber 
channel at the time of the lead actuation from a host. 

[Drawing 12] It is the mimetic diagram showing LU of Host LU and each disk array subset, and the 
correspondence relation of each disk unit 

[Drawing. 13] It is the flow chart of the processing in the host I/F node at the time of light processing. 
[Drawing 14] It is the block diagram of a switching packet 

[Drawing 15] It is the disk array structure~of-a-system Fig. which made cluster connection of two or more 
disk array switches. 

[Drawing 16] It is the block diagram of the computer system in the 2nd operation gestalt 

[Drawing 17] It is the block diagram of the interface controller of the disk array switch in the 4th operation 

gestalt 

[Drawing 18] It is the block diagram of the computer system in the 5th operation gestalt 

[Drawing 19] It is the screen block diagram showing the example of a display of a logical connection 

configuration screen. 

[Drawing 20] It is the mimetic diagram showing the frame sequence in the 6th operation gestalt 
[Drawing 21] It is the flow chart of the processing in the host I/F node at the time of mirroring light 
processing of the 6th operation gestalt 

[Drawing 22] It is the flow chart of the processing in the host I/F node at the time of mirroring light 
processing of the 6th operation gestalt 

[Drawing 23] It is the mimetic diagram showing the correspondence relation of Host LU and LU of each 
disk array subset in the 7th operation gestalt 

[Drawing 24] It is the flow chart which shows processing of the host I/F node in the 7th operation gestalt 
[Drawing 25] It is a disaster recovery structure-of^a-system Fig. in the 8th operation gestalt 
[Drawing 26] It is an explanatory view about a setup of shift pass. 
[Description of Notations] 

1 [ — A disk array switch, 30 / — A host computer, 70 / — A disk array system-configuration-control 
means, 200 / — A management processor, 201 / — A crossbar switch, 202 / — A disk array I/F node, 
203 / — A host I/F node, 204 / — Communication link controller. ] — A disk array system, 5 — An 
administration terminal, 10 — A disk array subset 20 
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!. v { i: ifi.iEtaft^ war*- § simms b t * y / -r & ftg«D,ie 

SiS^gi^Wt 51 1 0-0^71-7.7- Ki:, & 10 

-xy- fjftESi i o-<y^7x-xy- 

K i: ftHfE^OSi 2 O'f :x £ 7 x— X y — F i: ©HT-iffi 
£-r&IEtl^B->X7A 0 

[ta#*2] tufas i «o-f y*7x-xy-F«> me 

7b-AfcfljfEgi2C0-l'>'2 7x — xy — Fcoy — FT 

T ijfoESO io^y?7i-xy-Ki: M.iaii«©*B 2 to 
l , y^7i-xy-FfcOli'il T'ljiJrtE "7 U— ACD'ltoJ^fT 

WE#!filtflWRKar3*«JE'N y $r»fc«tS t£ftrc$mft 

(Dmrn^z^mrzctzwrntTzimm 1 iekcdis 

18f->Xfi>,o 30 

[fi"i'i*#i 4 ] ijfiiE7W— Af±> iinhEt-— ^teiWs M 
BEIH-W«KJ: 0iKittStiTV*3n 1 OdftSl!7 KUX'ftfS 

snfcwiswaflMHKa^^T^ miss 1 0117 fu 

XflHfi*, s£7 U-AcDfs^ftt &3lE«JlBt>-7v'X 

ht§ If** 3 IE*©IE1SSB-> Xfi. 
[lit** 5] MaEIE1S.gH->XT-A«, ffiflEK 

as¥SK:»» t , ^ u - * *r> 6 §mmm > x 7 a am 

LT, & y - F CO iiijHEttMiIf i'lSf — 7 ;MC iMilEffi&ttfM 

^is^-r * ssy □ -tr -y *r*mf %> c t ttsm t -r £ at 

** 1 tB«g<9§S1SSB~>X7A 0 
[fit** 6] MIB«lf$BUu S93E8t»«*^W8E«» 

oim&mmv y •> x 7 u^a> r t -t x %mm-t § 

c t * i: f 5 IS** 5 !E«cDf E1t^B ->Xf 

A 0 

[11*117] hijIE^ 1 0 / l , y^7i — Xy— Fl£> HutE 
h3?^K71/- AKJCm$LT\ K^h^WH so 



^XxAtiS6n§<t3s grZaiyis-i^icnteZS- 
F7' F UXtf/ffi^J-iDLTiKiifi^^BitC'pKiM-r 5 C t 
*Wtk %m#m 2 3E3fi«8B^K->XxA„ 

[§S3t<m8] h^ib^ 1 <o-rv^7x— xy— k«, mse 
f^-W1tA , f.giM?nt<5 t-*- ^ CO 'J - K*»w-r 5 u 

-K37>K71/-At(SSLT< giJ-H37yF7 
U- A<D«»i&^ L, Mia'>^ < 1 1 2 0(DgE1f.^E 
•9- y -> X -r A ( c h 9 IE 1 J - F n t V F 7 U - A WM $ ft % 
.t^tc.^^tO'J-FnwF^U-^fcM^sy-F 

7- f u^ti'/^ittabTiWifieas^ajciEas-r* c 
tmttzMimi 7 ,e.iK<D;?2te^:.wy->x-rAo 

[||*ffl9] MhE^ 1 «0-r>^7x— xy— Fti. SfftE 
U - F n v v F7 U— AlcfSg LTbuIE^ < i: t 2 o 
OEteSSB-y- 7 v- X t- A 6 5 n X < § 7*— ^ 7 v 

IS** 8 fE*£<0!atgSB->X-r A 0 

[W**i o] wia^ i co-f >*7x-^y-Ktt, Sij 
SBsm«^ steal fnK^f-^cj- F^m^t § 

|J-K3V>K71/- AtctS^LT, fulE'>&< i:t>2 

ocoiiats^iiwy ->xfi©5 ^^46>i£*6 e> nrc— cOiE 
tggg-9-y^xxAtc}g^-r^M2co-f'>'^7x-xy 

- F CD y - F 7 F l^-X-tf $B^r Wf E U - F n t > K 7 V- 
A {tin L T WIE$Eili¥Slc 5 c i: ^ Wrflt t T S 
IS** 7 IE«cO|E«gB^y ~>X-r Ac 
[W**l 1] x-^^^-rsiEIS^^Wt-SIEIf. 

»©ia«sa-y-r->x-r a a, gjssaaBSBKitsiftsn 
/i f*- * uffl -r 5 tnrai t one s§gt ? n s x * 
»rf*oT, M;ctH-w«fc«fia*n, iEtit^B^xx 

AO*»i«ff/«*«« L fc«?«rfi«l!-f — y ;!/ fc , iifj(Eii+P: 
^€>jMe>nT<§7P— AtC/S^LT, i71/-i.?; 
»«r Lx MIE+S/«giIx-y^^M#$ n^fflEtflfftW 

AtiSEf BMSB-9- 7 ~>X r- A<D V>-T tlAHC^S nfc* 

g(co^2co-r>'^yx-xy- Ft, Miami co-rv^ 
yx-xy- Fso*Mia^co^2©-i'v^yx-xy 
-K*«aBH«n» husB^ lco-fv^yx-xy-Fhrnj 

[E1CR05B 2 ©^ >y 7 x-X y — F t OIHITWfflB^ U 

[W**i 2] ifiiEMi icD^r>y 7 x-x y-F*\ flfl 

IB7l^— A{cW9B^2cr)-C>'^7x-xy— K©y — h* 
7' KUX«ffi*MinLTtB73-r5/^-y h*«^Sft*f 
L, MIE¥5iM^ISi±. tulEy-FTFUXt«$R^ao%> 
T fltlESg 10-<»7i-xy-Kk fWIB«^<om 2 £0 
•YyJ7i- xy — FfccOffi ThmIB 7 b- A jM^rfT 
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5t-r -5 flWJ'ff 3 ^ y 2*315 k , * ft « ^<*-r 

[MX£l 4] tuE:7U-AM\ (WIHf— ^*Ef*SB5K, 
MiatHHlK: «fc '3 EMarftT^SMKf*- * ©fSSftyt* 

l^T, tuHE.?S 1 ©SUIT K UX-lfffB*, IS"7U— A©*e 

3^ftt**,Etfl»if't*y*>x^/»rt-t?rf»i!*n*in 2 « 
*a!7 h c t*w«fcr «tH*¥i 1 3 ,e 

[MM&Hl 5] flWEX'f £P>(c, ffiE£& 

WWmi 6] ij(j,E2T5 1 0>fv^7i- xy — Kt±, iiij 

K7u— Aatf-ti-ucgK f-?7i/- Atco^-c^-ft 
nfc*i< u-a#'>& < fc 1 2 -DCDmmmmv 

-K7K UXflWB*f5fftlLTWIEK3SS¥®»c|EjaS'r* C 

[;'ii's*Ji'i 1 7] mEXi 1 ©yy?7i-x/- fi±, iw 
.Bfrnafr&iEassnT < sf-?o u - K««?s-r * 

ij-h'nvy F7U— Afc/SSLT. i'J-KnvyF 
7 A©*BI*£jS U ME'>& < & 2 ooEtt* 
B+r^X-rAtCHijE y-F3vyF7 U— Ajb^^ft 

5<fcd{c. m o u - F37 > F7 b- Acii^ y- 
ft KuxiwBSfsfftiuTmceas^afceas-rsc t 

a fc * 3 M&H 1 6 IEK©X-r -y f^io 

8] MIEsg 1 wy^7i- X/— F(±, hu 
ii'S U — F n v y F 7 U— Ate L TMflB^ft < k t» 2 4 0 

ooriate^itWT'^x-rAA^e.iiiKSSsnT < sf-?7 

[tt^qfl 9] WIBSlO-fV^^x-xy-Htt, Su 

iJ-KnvyK7l/- Afc/SgFLT, fufE'>&< tt2 
OOfiEtiSH-9-y->XxA£D^ ^^i6S46 enfc— ©IE 

'if:gB-9-7-->x^^tc^-r 2 co-r 7 x-xy 

- F<Q y — FT F UXti'JlB* iiuJE 'J - F*3Yy F7 U— 

ncma LTwimti&fmcmm' 5 c t &mtt% so 



©.KtttttiW 7'>Xfi,i:, iM.E IttftOiEIOStiW "7* >> 
x -r a tc ?ns -r- 2 ii -r s .h-w«c J-gfct S tl 

fc!33 1 «H>^7x-xy- Fk. &**MfflEE1tge© 

yy^7i-x/-F>, hues? i y^7i-xy 
- F&tfiMEfl^o^o-r:/*? x-xy- F*^i 

Jtl, DOES 1 (D^y?7x-xy- K£fflnEttft4)ffi 
2©^y?7x-xy- FkOBaT-71^— AOJittejgfcff 

wttim? % r? si!-r - y^^rffi'i a t rn'j.E^vMt,'/ ffitc 

1/ > TtMEIS^fH^ X t 1 U<om&nfikmt § fI7a* -y 
+)- 1 tf£T zeb %W&A t?& EttfiBS' x f - A 0 

[0 0 0 1 ] 

m*fflB-f Sf-fXi' ftiiJ8gl->Xx A©^Il77'tetcUa L. 
»C, f-V X^7$iJSSI->XxA«DSia^ fgnXhfk, 3 

[0 0 0 2] 

[^*OS«] W-»ti«>X -r A ic m ^ 5 ft 3 EttttB^ 

XxAk LT, M^<07-vx^iSB^sij'#-r§-T-vx^ 

7W->Xf^§„ rVX^TU-Y-yXfAiCO^ 
T(i, f^lx.ti*, "A Case for Redundant'. Arrays of Ine 
xpensive Disks (RAID)" ; InProc . ACM S IGMOD . June 
1988 (#'J 7*;U-T^/^-^U-^fT) KBB^S 
nt^3o f-fX^TLz-fli, mSc^^VX^SB^M 

tssii'f ^x^Afc j±^ b**JS si-r st$*i5-e*5. 

[0 0 0 3] aOrVX^TW-yXfA^, fti^tO 

(Fibre Channel) <DFabric£f£ffl LfcTaffi^&So C 
(DTjri^iifflLfcft^^XxAO^J^ Blxl/J F 
0-^7X1995.7.3 (no .639) r-> U T;l/SCSIA<V> it^J: 
rtTii^J P. 79 |I]3t;:7n£ftT<^3o CC(cBfl^^ft§ 

n«vx^AT-(i, ffl»o*xmvt;a-^ axT 
x-itmict^bt^) his<?)fvx77w->xf 

AA" 5 . ^ft^'ft, 77^t*M/l'LT777 l J7 
7ry"U-y^«i. ¥ .U±. 77W 
t*;l'©X-1'7fT'S!3, 777'J 'yy^itSSt^ 

«77^Af t^©A^7FT$S r7L/- AJ OK 
2itcML)gjiTfet)> *XF>f^X77W-yXri 
ti, 11^777'J -y ^gB%rt-^-ri.ci:^< 2,£p a <j 

[0 0 0 4] 

[^BJJA^Wa Let d t + Zma »Of-f X77K 
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t^-So LfrU C<9cfc?&*M<9{±77«, ^©^XffiiJ 
SI iz «t 5 a y F a - 7 «J (KO«*6ft ^, 7° a -tr -y -9" m<D 

ttw f*- * o»ffifM»«K: <fc s sijp v 7 f <Dmm<t t * 

7. F/*7* — WXjWiSHIrf 3„ c<DJ:-5aSgii v i 

[0 0 0 5] ISWrV X ^7 ->Xf A^M^7 7 
»cl!8iHxti# < & < , f^Tg^-rV X 7 7' U-T ^X-r Ate 

i/^o £/c, *x h^sasitiiawttf*^ x^sffl cass 

C0006] x-fX^TU-r^x^^^^fiisfkL 
«t 3 £ L/c^tc *x f*m»*t<^3 5^-'J wiim 

/SfcstsS'.!* § c i: tfT- £ 5 *X F tc <fc £ 5 5- U > 
^«fca6«:i;i|fa^— /Wy U >>*-r2>,teftE#« 

u^x^Atf^x^z^tcfiBUicffft'f ->xr- 

->X-rA» 7 77'J7^81ti> ^n^nffiiELfc^ffl 
ffiT^flS-rS^A^So £<Dtztb, fifSMf© hU- - 40 

v wmmivm-xic 1 1, * v « n x f ^tra*?- 
[0007] *aw©gww» cnc!ae*sti5tc*5^« 

£ Ot? # -5 lEttScB ^ X r- A £*3rr 3 C t ft 5 . 
[0 0 0 8] 

[.nai*wtt-r*fc*i»©^sa *^0/jo,eti2^M v . , v'Xx 



c <Diets^©«r!»ji»-rs ummm t*t®?z m&ofs® 

Z7x.-7.y- f\ ^^* , i,eta^i;w7'v'X7 i Aoi/^-r 
nfrfcttttsnfeWttosn 2 «^ 7 x-xy- f\ 
1 «-f 7 x— X7- KKt/ieao^ 2 CD-r > 
^7x-x7- KA^ttffisn, % 1 ©-ry?7i-xy 

- K £ JtS&£>3I 2 0-Y>'^f7x— X/— KtOim?7l/ 
[0 0 0 9] W*L<ti, gl0^^7i-X/-K 

[0 0 10] ift, 7lx-A03$5^ti:PS?LT, Sl<0^ 
y^7x-X7-Kti, ^cD7b-A^S-ttfX^^t7 

- K<7D7- FT KU^UMB*7U— i»KWlin-r*o $ej^ 
¥Sti7b-/,tCf^n^n/c7- FT KUXflWBfcfie-a 
T7^-A^f5^-r§ 0 m'2<D-C>^7x-X7-F 
ti, $E3M¥^6Stt£rXofc7U-A7b^y- FT FU 

7*'>X'7 i jutc'ite}M-r§ <J 

[0 0 1 1] *5gBfl«fe§ffitSfC43l^T, f21t^Ei>X 
■r A ti » teitHMSf c «»T § § S 7 e a -tr -y -y-* =e T § „ 

fiRgS-r - 7-;l/tc^fi)ct«$g^lS^^ § 0 flMMWBfc: ti , 

tl-®HA> 507^ -fe x^ffiijPiT § 

[0 0 1 2] 

im8<Dmffi<DBm im 1 ^mmi m 1 «, *«w 

-^^XxA^-^Jg^cfcttStf'MlilT^^o 
[0 0 1 3] Kif f -rX^7 / b-l'i>'X-rL„ 3 0(±-rV 
X ^ T U -Y -> X f- A m 5 n § * X F 3 > tf ol - ^ 
(*X h) T'^So rVXi'ZH'i'XfAlii, x-f 
X ^ T • < t7'-tr -y F 1 0, fi'X?7WX'f 2 
0 , 7-fX^7 >>Xr-l*±fc<Dm.'fe9m*i7 0 
X77W yXrAMfl^S 7 0. fVXy7W 
X-T-y^2 0 t f y X^ 7 WY i/Xf MMffI¥S 7 
0t<Dffl. #£Zf J r-<X'7Tl"{V7~*>>y hlOf-fX 
? T U-Y ^XrAtWfff'ISfS 7 0 t ©HflOiififrK >^ 
7 x— X (Jflifff I / F ) 8 0 5o *iX h30if 

-rX^TUM'S'X-r.M *Xh-f^7i-X 
(*X M/F) 3 1 T'&ffi-gtlTisQ. ^X M/F 
3 Hi7-VX^77'U-f'->X^Alc73T : VX^TU-rx-l' 
-y^2 Ot,C&!0i-?% o 7-~^X?Tl"<~>7,7-l±\(Df*)nr> 
tcfcV^T, f-fX77WX-l''^2 0i:fVX771/ 
-r-9-^-tr-y F 1 Oli. tVXWW^>^7i-X 
(f^X^7W I/K2 1 ) TS^^tl^o 
[0 0 14] *Xh3 0, 7 ; VX^7'U-i'+>-7'-fe-y F 1 



HUH 2000-242434 



0H\ HTtt, **4feS?nT^«^ cotjftfcflfl 

^tOiSOrfiftStlTt^o &*X h 3 OfecfeOF^r-r-f 
X?7UWty HOtt, *tHPn»J/rO*Xh I 
/ F 3 1 x fVXi7 7Wl/F2 1 VILAitZ titer 

F 3 K $^HifV7^7W I /F 2 1 WILT 10 

« 4 < . > X r A S ft § U^; Wc fls 

[0 0 1 5] H2tt, f-fX*7WiJ-7«lr7 H 0(7) 
-MM^StfMltS^o lOltt±ffi'>Xfi 

(*Xh 1 0) ^Ornv^F^PRLT^-v y->i 
7h^Xfl£?:*lL, ±fi>-X^Z*£*^y^f1S<D 
x-^$^^SiJ®*r^>±teT^7 0 ^, 10 2(ifVX^ 20 

;b^7 3 n -b >y iJ-rflJOJWf-r- * * * * U 

UXT^-^yv-o. • ^Jj^U fcuf-S) . 1 04ttf^f 
X * y ^ -9* y h l Ort tc *g,ft S ft § «»<D fVX^ 

is x t- i £#*flf a* sf^x*7W^fixi« 

WS¥S7 0^If|I/F 8 O^LTilfiU Writ'* so 

[0 0 16] ±{iLT?7* 1 OK **-yi/jL • 
tyi0 2, TUT??* 1 0 3«^ft^ftz:fiftSft 

rcTiiLT¥7°2 1 0 3<Dl/^"fft^6fe*JWRrflgt?*5o 
S^^^^yS/^^±tW^^U^±tfflLTl/^^\ cft£> 
[0 0 17] ±fu7 , ^7°^ 1 0 1 ±lu7'^7 c ^ 1 0 

i ©SJfti^firt" *±f4M P u ioio. ±fi->XT- 
A, nwfVx^7U^x^7f 2 0 fc<D8M* I / 
FT^5f^X^7W I / F 2 1 *f&l»"r StV X ^ 
7U^f I /F3>hn-7 10 1K+tr>i- ±±^f 
1 0 2 «h±fuM P U 1 0 1 0 tf-rX>7W I 

/F^yhD-7 1011 tcomcomm, r— ^eas* 

tT3±©/^X 1 0 1 2£r$fr 0 
[0 0 18] 0T*te§±fiT£V£ 1 0 1 fi^Cl^CD^ 
-f X^y U-T I 10 11 fc^SftT^ so 



I /F3>hu-5 10 11 i^\> 
[0 0 19] TiiLT#'7# 1 0 3t±. Titr??* i o 
3 0;|ilJ^^T"ri»TfitM P U 1 0 3 0, fVX^l 0 

fVX^ I /F3>hP-7 l03Kttr>a- ft : 
W^^U 1 0 2 fcTffiMP U 1 0 3 0 fcfVX^ I /F 
10 3 1 i:©HE>fflHi, ^-^KiM^rff^ 
Tfu^X 1 0 3 Z^iSo 
[0 0 2 0] mV&&TiiLTi?7$ 1 0 Sm^A^iT)^ 
^X^> I /F3>hn-7 10 3 1 *^afftT^S*^ 

*©»iffiB-c*9* f^x^7W«^ mm-? 

S-r-<X^ft»k:iSi:TaEiUBlflE"e*«o 
[0 0 2 1] fVX^7U^X-r7f"2 0O- 

««0J*SVr«/«HT*fcSo 2 0 Oti-rVX^TU^X 
-Y >y *-£f*©SJW*3 <t Cf «a*fr ^n-bymsf 
a^n-fe^y+J" (MP) , 2 0 lttn x n(Offl5X>f7f 

ees*«js^s*nxMx>ry^ 202^x^7 

WI/F2 1 S^itt^n^rVX^yW I/F7 
— h\ 2 0 3«*XM/F 3 1 ©»cKtt5ftS*Xh 
I/Fy-F\ 2 0 4^fVX^7WyXfAfMi 

So 2 0 2 0Bf>TX^7W I /F/-F2 0 2 £^ 
nX/U-T'yf 2 0 l^it§^X, 2 0 3 0WX 
h I/F/-F2 0 3 i:^DX/U^7f2 0 1 *8M« 
t§/U, 2 0 4 0U»fVX^7WX^7^20 

F, 2 0 5 0iiMP 2 0 0 t^PX;U>T7f2 0 1«: 

[0 0 2 2] 04(i^DX;U4'7f 2 0 1 E>«ifi£* 

■rflijsia^feSo 2oioi^DX/W7f2on<: 

8fcl!n/U2 0 2 0, 2 0 3 0. 2 0 50, feitf^ 
9X*lffi I/F 2 0 4 0Wit8*-htfe5X^7 
f>y#-h (SWP) TfeSo SWP20 10ttt^ 
TR— <Otgii«:WU S WP/)^(toS WP-^cOfH 

asaisox>r-y^vyww*fTdo 8t?«io<dswp 

[0 0 2 3] «F I/F/-F2 0 3£>— *i 

Bl|*-r*fca6tc*x M/F 3 l^rVx^J'Wl/ 
F 2 l Ojffi*tC7T>T^^^*;l/*ffiJTJ^St^fc{SXir 
t«o t%5A,*X FI/F3 1 i:fVX^7^ I / 
F 2 1 <h LTx 77^/^t^;W^>^7x-X 

fcjBffl-rscfcfcnifireaBSo *xi* 1/F/-F20 

3tf^X^7Wl/F/-F2 0 2CDfSj7j^|5]^£D 

*^SBJBffifctsi/>Ttt, fVX^7W I /F/ 
-F2 0 2feB^t*Xh I / F/-K2 0 3 fcRIttl 
fcAJfiJcSftSo WTT'tt, *XH/Fy-F2 0 3* 
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[0 0 2 4] 2 0 2 m'Sfl/:7r^^f t*^7U 

*^*«SR'T*«jRya'fe-y* (SP) , 2 0 2 214* 
XL 3 0 (fVX*7K I /F/- K2 0 2<Dm& 
H\ fVX^7Ut7t7 h 1 0) fcOMT*7U-A 

^^S'ff-r^-rv^^x-xnvhD-^ (i o > 2 

022«IC202 3 Sfl l/:7L/-A &C*t L S P 2 

0 2 l *<tt*Lfc*S»»cM-dv^Tas«*jSIS'r^-<-y^> 

V h a— y (SO, 2 0 2 4tiSC 2 0 2 1 if^L 
^ Lfc 7 Z^ftfi©/ — K tciciMf § fcfttc * a X^ 
X^f7f 20 1 *5aSitiT***JB*tC/^y bftr«^^r 
V h£fiMB (SPG). 2 0 2 5ttSf,»Lfc7U-i** 
— ^FWtCtSIW-ra^U— (FR) , 2 0 2 6 

— AWTffeSX^X^-iV^ (Exchange) *TOg'J*TSfc 
*6<DX ^ X^ x > ^#***a^ §x^X^x VS^r— 
yOl/ (ET) , 2 0 2 7aai^fVX^7U^^7-t 
*y h 1 OOWtSimW^fVX^TU^tt^fl 
T*— TOl/ (OCT) T*S5o 
[0 0 2 5] fVX^7WX^7f 20 OS-WricJW 
ti s t^T/N-F'JxTa S/ >y * S ti £ C £ 
ffg±S3:bl\, b^b, *a66n*ttH*«J5"C**a 

P2021^SC202 2<Dmt%^mt Z>£ti>"lfe 

[0 0 2 6] ^f-C^^TU^U-^y h 1 0t£, §^ 
^t§fVx^a;7 h l 0 4* l SfctiaacoiSS 
^fVX^a-7 h t LTfSLtl^o COSfcaW 
^f^X^a-7F«la-7F (LU) kPfrSCo L 
Utt, W»^rVXi7az7 M 0 4 1 *t 1 T»(5 
t4*Sttft<, i^)fVx?a-^H 0 4(cM 
©LUAW?n, £>£l/HA, jfi^cO-rVX^^LX^y h 

1 0 4 V 1 OOLU*«ritShTt*t)4^o 

[0 0 2 7] TYX^TWU'^y b 1 OOW^b 

OtuAOSSfcttaWaL UtftBlSSft, *X F30 
ti. COL mc#LT7'*-lrX-t* <£ ? tcJfrfrT £o * 
fJIMffi'J-ett. 1 ^LUWX h 3 0fr5iffii«Sft* 1 
ooi,utfi«sn5i^ *xh3 0fe:J:0B«lsn 
SLUSttiLU (I L U) , »R©LU-P*7h3 0 
fr&EIBSftS lOtDLU^MStl*^ *Xh3 
OfcJ:0G»*ft*LU*lfr&LU (CLU) fcP?-Ko 
[0028] (Hi 2 tc , 4O0)fVX^7Wf7-t7 
hOLUTM OO&t&L U*M»JSStt5»^c43tt5S 

T> 100 011, HM£LT. *Xh <4 #2"^6^fc 
f^X^7l/'<^XriA 1 O 1 OtD«e-&L UtCfcttSZ 
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KUX&IISL l 10 0(i, ^VX^TU^+^-tr-y h 1 
0OL UOT FUXSIB, 1 2 0 0(if^X^ar.7h 
104 (CdTii, f^X^7UWt7h "#0" 
tco^TOftH^SftT^S) <£>7' KUX'^l.'U^bT 

[0 0 2 9] #fVX^7W^7t7 h 1 0(731. U 
ti, CCTd 4^fVX^a--y h 1 0 4tcJ: 9 R 
AID5 (Redundant Arrays of 
Inexpensive Disks Level 
10 5) MT-fXtTU^ tLTffifi$.2ft%$><Dt-?2>o & 
fVX^7W+»-7-b7 h 1 (HA, Wftln 0, n 
U n2, n3 08i«StSLU*j$0« fVX^7 
U^Xfu/^2 (Hi, cn?)4O0LU0}.fO7Kl/X 
Jfilfll* (n0 + nl+n2 + n:O ©S!il*-fjfST H 

[0 0 3 0] **flHg»TU:. W*tf, *X h # 2*MB 
«A1001 %Tt7*z7sT fiW#A 1001^ 
^b/cT^-trXg^ti, fVX^7WX^^f2 Otc 
20 J:Df^X^7W'U-7'b7 h # 0<QL U4D13WSA' 1 
1 0 l *7^-b7t5fc«)<OS*tS8!SnTf^X* 
y'L-ft^-fc^y h#0tcte^^n^ o fVX^7W* 
y-tr^y h# Oti, nl'MA' 110 1 £:££>tc, fVX^ 
1-7 h 1 0 4±flDfiBttA" 1 2 0 tfV^bT 
7^-tzX£fT-9o 7KUXffll 000t7FUX$F3 

1 1 0 0 k(Dffl(D^y tfvyii, fVX^7WX^7 

*z o*^t«DCT2 o 7 icimznrcmf&mmcm 

[0 0 3 1] *S^T\ DCT 2 0 7it > 

H6». ^XfAMf-7;l/«^:, EI7tA, 

[0 0 3 2] B7fc:jK"r<fc3fc:, >/Xf^Mf-7;V 

2 0 2 7 0*4. *X h L UO«ri)t*^'rilW8*«»f « 
^X h L LHHfiScT*— "7^2027 K MfVX^7l/-YX 

-y^-2 0(Of^X>7W I/F/-F2 0 2 ^fV 
40 X?7WW7M 0fc©SttM«*^'Tf f >fX* 
7W1/F/- KttM-^— 771/20272*^1^*0 
[0 0 3 3] *X b L UtMf- 7;l/2027H±, ^X h 

§Host-LU No., L U OlBtt^^LU Type, CLU C las 
s, RtfCLU Stripe Size, *X h L U©«ffiS/fxtWS 
TfeSCondition. *Xh L U*«J*t5f-rX>7U 
^^-7-fe^y h 1 0OL UfcBM-S««TfcS L UW* 
(LU Info.) ^^-T^o 

[0 0 3 4] LU Typeti, C^XFLUtfCLU Tfc 
so «*\ I L UtS^^^^/: L UiDl'TiS'i^r^^'fuffiT 
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&Z>a CLU Classf4, LU TypetC & 0 C <7}*X h L U ifi C 
LUr*4C£*^£ft*i§£*:. tflD*?^ "Join 
ed" , "mirrored" , JkXf "Striped" Ol^Ttl'PfeS 
A^^"rfnffit?fe^o "Joined" (4, Hi UCfcDiBMII 

ttfimtwoc Lu«^nn^c^^t 0 "Mi 

rrored" (4 s % 6 ^fiSflSJffii: LTtfearT § <fc 3 (C, 2 0 
CD L U(C <fc 0 UMitZtltc L U T&S C £ J&TjVTo "St 
riped" (4, S7**fBffifcLT«»r*J:3K:* 

oLut«sn, f-?^cnb»LucMi 10 

rfefWn/cLU^^L^^to CLU Stripe Size 
(4> CLU C lasslC «£ 0 TStripedJ C £ tfTT^ftZ 

[0 0 3 5] ConditionfCcfcO^^tl^ttjlfCtJ:, "Nor 
maf , "Warning" , "Fault" , RXS "Not Defined" 
©4lg*^5o "Normal" (4CCD*X h L UtflEUfft 
tfltlT&S C^/^tc "Warning" (4, h L 

tin^L^^to "Fault" H\ fVX^7W 

yizvh i o <Dm^ eicx^c (D*x h l u ^EiMg-r 

SCttft'f^CtS/fxto "Not Defined" (4, J* 
JES-TSHost-LU No.<D*Xh L Urt^eStTtV&l^C 

[0 0 3 6] LU Info(4, il(0*X HU?:iJ5lit4 L 
©LU N, RZfZW'C X*7jfc?m n*3tSo *X h L 

snso *x h l u#c l u<otB^ct±, ^n^ii'M-r 
S^TCOL UtCO^T, Jtn^tKOLutctffl-rsffl^ 

Hti2tl£ 0 H(Ci5^T, Host-LUNo.tf 

"0" -p*SHost-LU«, f^X>7UW*7h 
"# 0" CO L U N "0" , fVX^7W^7-l!7 h 
"# 1" COL UN "0" , rVX^7W^7 h 
"# 2" COL U N "0" , f^X*7W1f^7 h 
"#3" COL UN "0" O4OC0L UfrZ>ffif£2ftZ>C 

LUV&K). *OCLU^7Xtf "Joined" 

[0 0 3 7] fVx^7U^ i/Fy^Ki«Sf-7;i/ 

20272(4, fVX^7l/^I/F2 lMt^fVX 
^7W^7 h 1 0CD#— hCffcfc:. E<Dt*47>2 
7WX^7f-2 0(Df^>7W I/F/-F20 

2 ? n s ^ *sr * -r s « 

[0 0 3 8] ^{Wj(C(4, fVX^7U^^7^7hl 
0«rWffi-rSSubset No.. h^W^TSSubset For 

tNo., ^<D#- K:iit^f^X^7WX-i7? 
2 0*t$Ji£-rs Switch No., RU^(D"r^ X^7' U-f*X 
<<V=f~2 OcO-rV X^7l/^ I/F/-K20 2*t*Ai£ so 
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t§I/F Node No.J&^TTSo fVX^7l/Y^7 h 

?(C SfVX^7W^7 h 1 0Ktt(frr«»flS 
(?)f- 7 r ;l/202720~ 202723^rWt"^ o :7VW4, "T 

^X?7W^7-t7h 1 0rtT«SS£ftfcRA I 

ji-y°<Dmf%*ttmm*im'?z>R a i d^/1/-7°#? 

fig-r— 7VI/202730 f^>7W*7t7 HOrt 

■r— yOb202740£ra-£y o 
[0 0 4 0] R A I D^l/— 7>$/£x~7";l/202730(4, 
RA I D^Vl/— ^Cf^PSnfc*^*^ Croup No., 
f^RA I D^VI/— 7°cOU^I/^or Level, fORA 

Disks, fORA I Dy;l/-^RA I DU^;l/0, 5 

■9">TX*^-r Stripe Size*«a}fcLT^ty 0 (M*fcf* 
HESStl«f- ^OMCfev^T, RAID^b-y 
"0" (4, 4^fVX^a-7h(c4t)M^ti/cR 
A I DW-^SO, RA I D1/^W5, Xh7^ 

[0 0 41] L Utt'MT 1 — 7~;l/202740(4, LUW#0? 
tlfciHf (I. UN) No., COI.UtfMRA 

I Di7)l— Zffo&J&%nT^&<Dfr%7fC?MIli Croup, 

L UOttffifc^TConditioiu COLUWX (2? 
S) ^^Size, :OLUtff-fXJ7UW-byh 

1 0 CO if (D#— hfrZTt? -b X oltl^CO A^^t" Port, 

& tf -eco«# fc % § h a 1 1 . For ttt'tmR t l 

T^tSo Conditiont?S*tlS*Rffit4, ^XhLUfCO 
l^TCOConditiontRJtll, "Normal" , "Warning" , 
"Fault" , "Not Defined" CD4ff(SW££ 0 Alt. Por 
ticmfcZftfZWtmc£9WteZft%#-h&, PorttC 

[0 0 4 2] [38(4, 7T^/^ir*/Wc*3tja7U"- 

(4, 7lx— ACO^taR^TKf S O F (Start Of Frame) 4 
00, 7l/-^7?40K (EaSomHf*-**^ 
t5MT*$57l/-^D- H 4 0 2, 3 2 fcTy h 
CDX-^— j^ffln— Ftfeli C R C (Cyclic RcdundancyC 
heck) 4 0 3, 7U-A(DliMStFOF (End Of 

Frame) 4 0 4^ o 7 JU'N y # 4 0 1(4, M9 
iC^X o t&m&.^IZ-i T4o D . 7b — ASsjMtcCO I D 

(S_ID) , 7 AfciM^fecO I D (D_ID), X^X^-ji 

v^coeKiTt:, f^ista^nfn^x^xfx 

>S/I D (0X_ID, RX_1D) , X^Xfxy^©7U- 

u?)\>— y^m^z v-y>xco i d (seq_id) 
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[0 0 4 3] -fc'MffiBmvii, *X h 3 0 K X 0 »firS 
tl^7U-^c(i, S_II)<fc lt>tX F 3 0 fcgij 0 iiT 6 

2 0O#-Mc;W9MiT&ttfcI D^ffiJIIStlSo — o 
<B#XFriv;/Ffc:#tU l^)xnfx^'l D 
(0X_II), RX_ID) tffflOST&tlSo Mfc©"^— 

iijo^T^n, tiOfcWy-yyx^^yh (seq.cn 

£\ H 1 OKl^T J:?^ SCSI ^Logical Unit Num 
ber (I. UN) „ Command Description Block (CDR) 
^W?n§ 0 CDBtt, f^^ (fVX^71/ 

Fl/X (LB A) . $Si£fi ( L EN) £r^O 0 
[0 0 4 4] iXT\ «lft^fVX^7WyXf 

[0 0 4 5] fVX^7^^Xf/A^ffltl»^^ 
F 1 04o£tf^VX^7'U^X-r*y?-2 0 <D 

^X^T'l^+^-tr-y F l 0fcJ:tffVX^7WX^ 

ows/L'W/fli*iiEas"rao miasicfc 

[0 0 4 6] fVX^7WX^7f2 0m iiffin 
> F a— 9 2 0 4 **R©Nra*fflf#U MP 2 0 0(ci 
D*f-fX>7UW*7 F 1 OOTFUXffilWlWB 
§0#!fi!c«IB*<iaSSnSo MP 2 0 0(1 ^PX/U 
20 1 Ifitg^X F I/F/-K2 0 3*5<£tf 
fVX?7W I /Fy~F2 0 2*C, f^fX?7W 

[0 0 4 7] S7-F2 0 3. *5<fctf 2 0 2ttce>«* 
^IS^TZt. SP 2 0 2 UaOW»DCT2 
0 2 7tCt&|frr5o f^x^7U>rw^ MOT 
tt, f-fX>7UW*7 b»J**l¥Sl 0 6^ 

U JWf^'J 1 0 2*C««rt-*o *± 
(4MPU10 1 O^octCFTteMP U 1 0 3 Oti, ttWy< 

[0 0 4 8] UTTtt, *Xh "#2" tffVX^7U 
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»ift*JKifl-r*o 111 l*^ tahfr6©y-K*iffi* 
*vx**vrii!SCBI** Hi :ucctof:^fVx*7 

U^X-<7fWa h I/F/-F2 0 StCfcttSilfijft 
(?)7n-f ^-F^t 0 

[0 0 4 9] &*5, WTOKWTHU «h "#2" 
t>\ m 1 2tCt5tJ-*8Sifl««A 10 0 1 ^7'^-tzx-r^ 
iii:*<E5£f5o IB1SM4KA iooi 
10 |E«fiS«A" fck, f^>71/W*yh "#0" <D 
LUN-0COL U*«5figt"S-r>r7,^a— y F# 2£)T 

KuxasmrtJcflFfiE-rstofc-rso *fc, 7fuxs 

IIU 1 0 0 0*«Wtr* L U*ft«LTV**;* F L Utt? 
ESt"— 7j]/Z027\<DUI TypctCtt l~C L Uj fr\ CLU C las 

stCtt TjoinedJ ^snti/^t^tt^o 
[0 0 5 0] -r— ^O'J-FBf. *XF3 0a, >J — F 
3 7>FMl/:^yF7l/-i, TFCP_CMDJ 

^x^7 , ^-rx^-y^2 otcfgfrrs (mi l^ffi 

(a) ) o rVX^7l/^X^7f 2 0WX Fi/F 
20 F"#2"tt, I C 2 0 2 3ta^tXF I/F3 

184737VK7U-^ Tfcp_cmuj ^S^f-f £ (X 
-r*y 7°2000l) e I C 2 0 2 3 tt, SC 2 0 2 2IC37 
> F7l/-i*?:'|g2St5o SC 2 0 2 2ii, WKo/c 
37^K7U-A*-IF B 2 0 2 5JC«ttt«o C(?) 
85, SC 2 0 2 2tt, 3V>K7U-A(OCRC4tt» 

KDtf&ftfcf, SC 2 0 2 28, I C 2 0 2 3 

tcilftl-rSo I C 2 0 2 3H\ §£D<DiI&l£:S C 2 0 2 
2fr£gtf3i:. >tXFl/F3 l*Mt*XF3 0 
30 R CX7-M£t§o (X7^y7°20002) 0 

[0 0 5 1] C RCtfjELl^*&, SC 2 0 2 2^ F 
B 2 0 2 5K«t3fLfc7U-i*«U— FU Wtf37 
>F7U— A^fe§ci:^ii2i!iKbT^U—iA^^^4 0 

1 *(5?#ff 5 (X7^y 7 C 20003) 0 fbt, S C 2 0 2 
2*4, S P 2 0 2 1 KjgjSU S„ID, D_ID. 0X_ID^O 

X^Xfx^MSSE T 2 0 2 6t:iat8 (X-r^y 

7°20004) o 

[0 0 5 2] SC 2 0 2 2H 7l/-^n- 

F4 0 2»U ^XF 3 OtCiO^^tlfcLUN 
40 43<fcaFC D B^JRifTS (X-^y 7°20005) 0 SP2 0 

2 Hi, SC 2 0 2 2^ffi^a^ DCT2027^r 
tfcSSU r^X^7W^7 F 1 OfDtWti'/i^? 5 .} 
£o ftttWtett. S P 2 0 2 1 *X F L U«ja-r— 
:/;l/20271*8HKU SfltLft7U-A^P-K4 0 
2tCtS*ft^n/cL U Nfc— SrTSHost-LU No.^frT^ 
1f$B#fi.Ott5o S P 2 0 2 lte, LU Type. CLU Class 
tcfiffi?nfc««^6*XFLU^)«!j«*BI«U lu I 

nfojef^^nrv^tSffi^ao^T^^x^^T-v 

X^-9-y-lr y F 1 O^WOLU^LUN, Stfctf) 
so LUrtWLBA^ffflt^o *C SP 2 0 2 1 (4. 
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40*r#RBU S«Of-fX*7Wm^ 
M*-h*«iBL^ fVx^7Wl/IV-KMr 

6 F «C»ttf ^fVX^7W 

I/F/-K2 0 2©/-FNo.Sf#4o SP 2 0 2 1 

fcSRS'J't S L U N , L B A SC2 

0 2 2lC$S£"f£ 0 (Xt-^7°20006) 0 
[0 0 5 3] Jfcfc:, SC 2 0 2 2S, JlttLfcXfttiMH 
*ffifflL7I/-M>rn-F4 0 2OLUNkCDB© 10 
WLBA«gftt5 0 7U-^7^4 0 1 

F I /F3>Fo-7 10 11 <DD_IDtcSgfi6*rSo & 

43, c©^jaT«s_iDU:»*iBiAav^ (Xf7 7°2on 

0 7) o 

[0054] SC 2 0 2 2^ SM^37yF7l/- 

Ai:, SifVx^7Wt7-t!7 F i oicmmir&T 

^ X5?T U-Y I / F/- FS§^ X S P G 2 0 2 4 teg 
i£~T£o SPG 2 0 2 4(t SW^/cgfttO^Ty 
F7l/-iA«U Ell 4tc^-T «t3S:B!#«:te3i^^ 20 
^6 0 1 *{*taLfc/*5r* h^Mt^o F 
5:X^7f>^^7 F (S Packet) 60^f 
&o S Packet. 6 0 (DWM^y $ 6 0 1 tC& N i|EjMtg (1:1 

£ft£o S P G 2 0 2 4 tt, SSLfeS Packet6 0*^ 
PX/U^7f 2 0 1 tCiMff-f £ (X-r-y 7°20008) 0 

[0 0 5 5] ^PX/U^-yf-2 0 1 It, *X M/F 
y- F "#2" fcjg^-rs S WP 2 0 1 Otcj; DS Pack 
et6 O^SfS-T^o SWP20 10(i, S Packet 6 0 <D 
Wfk^v ^601 *#EHU (ES55toy — FA^»tt"r« 30 
SWP^(DX^y^fWffl*tToTli8S*Bfr:jiL, S Pack 
et6 O^r'lEJMTfeO-rVX^TU-r I /F/-K2 0 2 

CllTH fVX^7WI/F/-F "# 0" ) tC 
(EiS'TSo SWP 2 0 1 0«\ *lSS«OfiSiE«:S Packet 6 
O^SfflOfiMClfefiBU S Packet 6 O^iM^T L/c 
6. *©«8&*W«rrs 0 fVX^7U^I/F7-F 

"# 0" SPG 2 0 2 4tfS Packet6 0 

^SC 2 0 2 2fc:«rr o 

[0056] SC 2 0 2 2U:, S^ft37VF7U 40 
— A071/- i*^*y ^<DS_IDtCg|#© I D^TifSiiOo 
#«CS C 2 0 2 2B, S P 2 0 2 1 tC**U 3V>F7 
Is— AOS_ID. D_ID. OX.ID^CDX^X^xyi/'lf^ 
Rtf 7 U-A$zu£t£*X F I / F y — K#Jf * E T 2 0 
2 6*ca»-rSJ:-5ffiSL, I C 2 0 2 3 len v> K 7 
lo—l±%:&mTZ>o IC 2 0 2 3«\ 7L/^7^4 

0 \ <Dmmcm\ ^nf^x?7i/>f^7h 

1 0 (CCm fVX^7W^7^7 F "# 0" ) 
lca7yK7l/-A*i|6St4 (Ell 1 ^EH (b) ) 0 

[0 0 5 7] fVX^7l/^^7-fe7 F "#0" 14, S so 
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MoaTyF7l/-L rFCP.CMDj SfVX?7W 
1011 -eSffl|-r*o IfiMP u 1 

0 10^ 3V^F7l/-A(D71/-^D~F4 0 

2 Ktt«?nft LUNtCD ffi>ifSftfc,» 

>y FO L B AfrS L E N^f-^^'J- Ftl) 

[0058] ±fi m p u 1 0 1 0 «\ tt^jy u 1 0 2 
tc tett s ft fc * + y s/ a Ba*«**Ha U * - W a. 

H>y h^X/t: y h«jg*f=r5 0 h*ftfcMr+*S/ 
a 1 0 2 ^S-r— *(EaS**M-r*o ^X<£>if&, r-V 
X^zL^^y F^bf-??: , J"Ft4^fe§OT\ 
KA I D5«{:SoX7Fl/XgM^lU +^ 
y->i^|lll*J*«-r*o fVx^az>yF2^ 

6 © 'J - KWSII^i&agftfflPIIti'/WSrSfefiK U TttMPU 

1 0 3 ok:«a*gis«i<^<. tt^y^eu 102M 
a****arr*a 

[0 0 5 9] TffiMP U 1 0 3 OfcL tt^y^U 1 0 2 

*cffia««*<«^ 

TfiMP U 1 0 3 0tt Sa^Jft-r-f I/FayhD 
10 3 1 ^^tU fVX^a- >y F 2^MDU- F 
37>F^Mlt, rVX^I/FnyFn-7 10 

3 l tC3T>F*5Efr^*o t'VX^ l /Fnyhn- 

7 1 0 31 (i, rVX^a-7 F2t^£ V — F Lfef*— 

•yv'oL 1 0 2 0jgSSftfcT FbXtcMlt 
TfuMP-U 1 0 3 OtcftTS^ftiiSP-rao "RftMPU 

io3 0B, ffiatfiEL<ft7Lfcc£*±{4MP u 1 

0 i otciiai^<i±wy^u i o 2 MjaajRTKrta* 

[0 0 6 0] ±{ump u loioa, ft^ry^u 1 o 2 

fcffiaiRTflWH^*»lSftfcil fc*38»cffla*BM 
U rVX^b-f I / F nyFn-7 10 1 U:U- 
Kf f -**P«5te7*3HI»I , r*o rVX^7^I/F3 
yho-7 10 1 Hi. rVx^7WX^7f 2 0O 
SifVX^7Wl/F7-F "tO" tCjttU 77 
/ ^ -v * ;!/ fit * 5 -r— £ K3M*f/»^ 7 7 A T* $> 
§ TFCP.XFER.RDYJ ^fgfrTS (Ell 1 (c) ) 0 

[0 0 6 1 ] fVX^7WI/F/-F "#0" T 
fci. f-?f»iS77l/-/, l~FCPJ(FER_RDYJ ^§ 
faTSt. SC 2 0 2 2^ f>X^7 Wt7-t7 F 

2 O^eSfibfciiS^X^X^-xV^ I D (RX_ID) 
#Jffift*U S_ID, D_ID. OX.ID^rJR/ilLT, S P 2 0 2 

1 Kffi^LE T 2 0 2 6 0^Mx^X^a:>v ? t^ffitCRX 
_ID*aS"TSo SC 2 0 2 2B, f-^l»i^7 
7U- AtD(gaS5t (^vv F7U-A£>$5jMt5) <D*X 

FI/F/-Ft§^I{#t§o SC 2 0 2 2^ S C© 
71/- A(DS_ID«:M?AftL, S P G 2 0 2 4 tC$siaTf 

SPG 2 0 2 4tt, 5fe^at^fc<fc3tCLTS Packet 
*t«L, ?DXMX^7^2 0 1 iit'Wf^X F I 

/iv- f ,4 # 2" tcess-rso 

[0 0 6 2] *X F 1 /F/- F "#2" SPG 



tJflftl 2000-24 2434 



17 

2 0 2 4 tfT-Zmmmm7%TyU-L.<DS Packet*g 
iWt%t. S PacketOtta-^y ^*^L rFCP_XFER_RU 
YJ %\H0iLT S C 2 0 2 2^?)S-r (XT^y 7*2001 1) o 
S C 2 0 2 2 fci , S P 2 0 2 1 tCfftTp L E T 2 0 2 6* 

7°20012) o 

[0 0 6 3] $UC, SC 2 0 2 2(i, 7 U— Art* rFCP_ 
XFER.RDYJ T?fe^^if^^P^ (Xf *y 7°20013) , TF 
CP_XFER_EDYJ T*tl*4\ E T 2 0 2 6 ©J^^c-X^ X 

I D (RX_ID) <E>S#r£:S P 2 0 2 1 iCjg^ 10 

icWMZftT^tzmm&ttlZftZ (Xf-y ^20014) o 
fit, SC20i!2tt, 7U-i / Ny^4 0 1<DS_I 
D. D_ID**X h I /F 7— F2 0 3WI DtW h 3 

o<o i D^ffli^fca-wafistc^sj-rs cx-f-y :/2ooi 

5) o cnf)(DMI^ci;D7l/-A^y^4 0l^ * 
Xh "#2" ^t§7U-^^^Wo IC20 

2 3Hu *xh "#2" tc*tu c(D-r-^mmmm^ 

77b-A rpCP_XFER_RDYj ^WilT § (0 1 1 £)^£P 

(d) : Xr-y7°20016) o 20 
[0 0 6 4] f-<Xi77Wf7t7 h "#0" £>rV 

X^T'U^ I /Fa> Fn— => 1 0 1 1 II t— £>|£3M 
teftdfcbb, f-?7l/-A Tfcp_DATAJ -r 

(e) ) o 7U-^>fn-KOKaSfitctt«iJia^fe* 
fc#K 1 7l/-/,«T-t§I^f-^S^2 KB 

-^^u-A^r^Lfgff-r^o t^rof-^7i/- 
a IrI— <dseq_ iu^sij o a r ^> n 5 0 f-^7i/-A 

* iEas«pfii^:7 7 u - i t una -efe * o 
[oo6 5] fVx^r u-rx^y^-2 ot±, -r— *<e 

fFCPJ)ATAJ OTl/-^y^4 0 1 O^g^Hfigf 

Bfi tc £> t 1 £ x r- v 7°2oo 1 4 co fl&g tt x+77 p snSo 

7U-^7^4 0 1O«> f^X^7^X^f7 
f2 0a, *Xh ■*#2" tCT"— ^71/- Z^ESS-fS 40 
(H 1 l ^91 ( f ) ) o 

[0 0 6 6] #tfC, fVX^7W^7 h "# 0" 
©fVX^7 l^f I / F^> hn-7 10 1 Hi> £?7 
Xf- -**iEa£*fT?fc«K Xf-^X7b-A TFCP_ 
RSPJ *£tfcU f^X^7WX^f7f2 0tC*tL#8 
frTS (Ell l^EP (g) ) o rVX^7WX^7f 

20m -r— ^Kas*fli^77u-i*o«afcn« 

tC. S P G 2 0 2 4 tfS Packet*^ e>4£3B^y #&9\>L 
TFCP_RSPJ Xt- ^X7b- A*W8"il/ (X7^y 7*200 
21). S P 2 0 2 UCcfc D E T 2 0 2 6 4^U*X so 



18 

9-jL>ismi*mm~f% (XT-y7 e 20022) o SC2 0 

7^320023) o S?ft£*lfc:7U— Z*(i, I C 2 0 2 3 (C 
iD^Xh "#2" fc:4E2££ftS (Hi l^En (h) : 
X^y 7*20024) 0 utf&lC S P 2 0 2 1 (4, E T 2 0 2 
6^bX^Xfx> ^flttB^fflWrr S Uf7 7°2002 
5) o 

[0 0 6 7] WiOctatcLT-r-f X^T WA^O'J 
— Hffla^ff *>tl*o fVX^7^yXfAlMt 

[0 0 6 8] 0 3tC7nb/ccfc3tC, fVX^7WX^ 
*y^-2 (Hi, ?DX/U^7f 2 0 1 tC^^X^I.'il I / 
F 2 0 4 0£ffx.T^£ o El 1 tC^Lfc^XT-A^HicT 
14. >7Xi?H I / F 2 0 4 Ottf fflSntt^>o * 
HIilC0rVX^7WX^7^2 0^ ^7X^PI 
I/F 2 0 4 0 *?Uffl LTg] 1 5 frC^f «fc 5 frC, fl&O-r 

[0 0 6 9] #^^<£K*5tt3fVX?:7' WX-f-y 
f-2 OWffiTti, *X h 3 0 W9"7-b»y 
h 1 0*^8#*TbJW»ttT*4«/^, 7^X£|.",| 
I/F 2 0 4 0£#JfflLTtt8&«7 :: VX5'7'l^X-f'-y 

T*X F30tr^X^7 >y h 1 0 3 

[0 0 7 0] ^HffiJ^ffiTfi, fVX7§ 

>r! J <?'ttf?g©-2v'ii;tttc-a-^^T. f-V X ^ r U-r-y-T'-fe -y 
H^X h©SE«!^»*ifWinbTt^< C i:^T'§5 0 s 
fc> ^S^Ie^^W^X h l/F»t*Xh- 

r-Vx^7H'->x^AF^it^-rsci:^TtS(D 

[007 i ] w±KWbfc3feiSJBiiiteJ:ntf, i ^©-f-* 

I'X^T'lx^-y-T'-b-y h£Dl<fe#l^\ rta(5©MP u-^rtgp 
/ ^X -efWPB ^ nfc i: L T t, , *»<0 f^X^7Wt7 
-tr-y h^rJIj^T, f-V X^T'^X-T -y^-tci 0*X h 

tSo CftfCiD. fVX77W-yXfAh-^i: 

■9-^-tr-y hOttHl^JrtK^fgV^OTfeoT*^ IfflSO 

li-e#§o LftASt, ffi3Xh»fYX77^^7 
•fe-y h«rn>eii— ^^X-^Acolg^c-a-fe-a-T^S^: 

h T^V X77W ~> 5Ck ^"Jftg i: ft 
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[0 0 7 2] f>X^'§iOii^ttt^^j±^ 

[0 0 7 3] S&teSfc, #*fiSJB«teJ:ntf, fVX 
^ZU^fit^-by F£LT, »)f^X^7l/^yX 10 

tLs^cd t o©tt/h«*ffl s c £ *<T' # s tor, SJEtc 

[0 0 7 4] [&2£ffll»eftB] B16U, *»W©*2 
co*»Stc fit * § n > tr ^ - * >x -ri*o«jSBir* 

U 7 b- 0 2&^L&i/\<£u SO\ 

fVX^7WX^7^ >tXM/F, fVX^71/ 20 

>r i /F^zimfbsnT^ai^Ta 1 ^js?6yg!tSfc«Wt 

±tfliffi-r*o Lf^bt, SfW4)*»j«HU 35 1 'JflfiSJBffi 

[0 0 7 5] [11 6lC43<^T. SfVXi'TW^ 
>y F 1 0tt. a»«0*&a^»=-^ h (LU) 11 0 TNHjS 
Snt^So §LU1 1 Ott, JSiLU^LTMSn 
3 Q — UatC. SfVX^7W'9-7t7 h 1 0f*J*DL U 

1 1 OtcWOMSTSnS LUNHU OA^J&SSMS 
^r365o C<0fc*&, ^Xh3 0Htlt, fVX^7 30 
U^i/X^lf^-T^TcD L U 1 1 0 © L U N *2Jl*w 

^D-F4 0 2 L UN7Y — ;b F#^g&*r 5£>g# 
£>£o *HflBBffiTtt. §fVX^7Wt7-i!7 F 1 
0(DLUNS ; tOS$*7h3 0tCl«SC4:T% 71/ 
-A^ F 4 0 2 ^MT-S^ f>X^7U 

[0 0 7 6] *i WlOf -Y X ^ 7 U-f X-f 7 f 2 0 
fcfc, $X M / F 7 - F 2 0 3 C^C^fV X ^7 
U>f1t7-b^ h 1 0&7'21i7.TZ%$><Dt{fc'/xL*?%o 40 

-OC*X FI/F31 1 &£>-r 

^X^7'U-f^:/-b>y F 1 OtC&a L U 1 1 (HDfrtfT 
^•feXRlfilT'ftSo l^^XF^bflltofVX^7 

F 1 OcDLU 1 1 0 
tcti, fO*Xh*ia«*Xb I/F/-F2 0 3tC 

aasfrso awxh3o^bi^fvx^ 

TU^y-t^y F 1 0C0L U 1 1 O^rZ^-bXT^i: 
3tc-rs«^±. P-^tXFl/Fy-F2 0 3^ 



1 &<D*X F3 0A>bl L U 1 1 0^7^-feXtl) 
I/F/-F2 0 3<OD_lDf5*CT 1 VX^7' 
U-f+^-by F 1 0*M*^*efcfc:ftSfca&> SLU 
CDL UN^OSS^X F 3 Ofcii-ti-SCfc^nlilgrfe 

[0 0 7 7] ±izELfca*K:J:t). * 

X F 3 OtC, SfVX^7U^7 FlOrt^LU 

1 1 0^L UN**OSS*X F 3 CUcMtfTl^Sfc 
46, r>fX^7WX^7f-2 OlCtJttS L UNOgft 

tt^EfcaSo ccorctb, f>x^7Wx^7f2o 

«U *X F 3 0*^7U— A*SM-r«fc, 71/-^ 

7^4 0 i <DH&%i\ ^mmtmmcLT&mL, ?u 

-^D- F4 0 2(i^^tC^VX^7'U>T*9-y r 
•by F l 0tcteai1-^ o *^ffiJKrStc4bnt§^ l ' , ff$^®]ft 
ti, 7 l/-L^>r n- K 4 0 2 ft btift^c i: 

ftKra^W-TSo .fcfttf* fVX^71/ 

^X^y^2 0OBH«*S»tc-e#*o 
[0 0 7 8] 3 £HHftlB] £ 2 *flKB«"eti\ -r -r 
X^7WX^7f<D*XF I /Fy— FtCtSV^T. 7 

3*fiffiff>SST(±7U~^^N'y^t'§'i6, 7l/-A« 
Sfrfeft v Affile o^TrWRFJ-r 5 o #SJUSfi«!HE> n > b° 

[0 0 7 9] tS£Xffi2$im&1Rt>l&. *X F 3 

0»CWU fVXy7W^7-t7Fl0^i^ L 
U 1 1 0<DMf£m. fVX^7WyXr/,l^«« 
dt«rl»jRLTl^ao ccofzlsb. *X F 3 O^btifVX 
^7W^Xr/,l^frt 1 0<OlE«S«i: ITlx. 
5o CftfcSU *HSS^T*C±, fVX^7l/^f^7 
-b7F 1 05^SS*X F 3 OK^IftJU *X F 3 0 
^7 U-i^y ^(DD_IDfc LTiKSfr f -f X ?Y l^CV? 
•by F©#— F<D I D*f£*S<fcdfc:"f"So £tUC£ 
fVX^7l/YX^7^ 7U-^7«S 

(OX>f7f8I^fVX^7l/^X^7^2 otc@^T 

[0 0 8 0] fV X ^7 7 U-Y ^>Xf Atl^f 1¥S 7 0 
t±x rVX^7U^t7-t!7 F l OtDiilifhinvFa— ^ 

1 0 6. MrVXy7l/^X^7f 2 0 (OiQHS¥S 2 
0 4 ^Iilt§fVX77l/^^7-t!7 F 1 O&tf-r 
^X^7U^X^7f2 0<DtttfttlH£&f»U $>av^ 

[0 0 8 1 ] fVX^7l/^X^7f-2 Ott. S*WtC 

t±H3tc^*rm i ^fflm^cfcttaT-vx^Tu-rx-r 

*X F 3 0^W§7U-/,^71/-^7 
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mmmrn. &?> v 2 xntmt&VT* ^^7^^ 

7f2 0 C0*X H/hV-K2 0 3, f^7*7W 
I/F/-K2 0 2 Tb^J-T DCT 2 0 2 7^ S C 2 
0 2 2. S P C 2 0 2 4 'StC.fc D^SiSft* "7 U-A'N 

-N-y ^<Dtf fB&C?£oT*X h I / F / - F 2 0 3 , Ktf 
tVXWW 1/F/-K20 ZOfflt^/^ft 

[0 0 8 2] 2N:gfeM6f^ffiT'{i, f^X^7W->ZrA 10 

* r iLTrfj'j!-r*fci6te, x^r u-rnnuur— 

-Y^X7^^fi!cgfI¥S7 OtCfi^S, -rVX^TU-r 
S/^-f-ZvHWWg^H 7 0 tffltx. 5DCTB, 0 6, 7 
tCTfv-T. >/XfAMf- -771/20270 i^r-try Hifilt 

-r— 7 f ^202720~202723£O 2 OCf- 7Vl/g££^Cy 0 & 
£k ^^fite/KST'li, *X h L IKi^T I L U t LTffi 
/jSt^n^fctf., *X h L UMl&T— >Ol/20271<DLU Type 
t±^T ri LUJ t CLU Class, CLU Stripe Size 20 

[0 0 8 3] r¥*Wftt, rfI l l!i!a*5?rfWLTf-VX^ 

W+)-7t7M 0«fVx^ffl, fVX^az7 h 
©*f»3F©««*f#T, fVX^7Wf7-fe7h 1 0 
OLU1 1 OOIS^, R A I D ]s^)\s<DWa£M*i7r>o 

©g*s* 5 sc «t 0 -rv x * 7 ->x-?- 

2 O^ftsiJ^LT, S*Xf-3 0i:fVX^7W+)-7-b 

-y h 2 0 M<oMffi-w$a*aa«-r s 0 30 

[0 0 8 4] U±(DWmz£9, ■r-CX^T'U'i ~>X^ 

^i<Dffiia>w*£u *x h 3 ofrzvmwmitsW) 

ICL Ul 1 0^M^.-SJ:3tC^5o f-fX^WlfS 
«S¥S 7 0 ttU±©Rj£fll**«?F U fltfr&O 

So 

[0085] #Hfifcfl5ffitc<fcn«\ nttczfr^xtT 

HOtt, [rI — <D«f^«*cJ:oTtt— Wtc» 
TU-f->X-rAtcH#«l*.*«^i:. ^Xh3 0^ 



[0 0 8 6] [354 ftflgJBffi] fcLhBW? LfcS 
3<Q^J»g!®"C(4, tab I /Ftc^r-f/*?-**;!/* 

[0 0 8 7] 1111 7t4. *Xh I/F*^7U;kSCS 
I T'&5*§£©*X H/F/-F2 0 3l*jg[W I C 2 

0 2 3 <D—ffif£ffl*7H1r 0 2023014^5 WUS C S I <0 
7°n hn;l/»J1»*fT^ SCSI 7°o b > h a— 5 

(SPC) . 20233*4:7 7^/^^*;l/07°n h n/14-iJ 
jSS^tf 3 77^ft^7D (F 
P C) N 20231 (4/^ Iwl/S C S 1 i:77^^ft*/l/ 
0»U7';bS C S I ^7°n hn;l/^^-^>"7°D Fn;l/g? 
B^n-by**- (PEP) . 20232f47°O h3/l/»f 
-^^-^ffi^^/^^^r (RUF) T'feSo 

[0 0 8 8] #H/*JBJfitC43^T, *X h 3 0(4. 
X^7Wl/F/-K2 0 3^ltSCS I 37> 
K*«fT , r*o U— K3VVH(D*&, SPC20230 
As Ctl^B U F 20232tCf&ttU P E P 2023 HC#] D ii 
^Ta7yF(DSiS:IB§ , rSo PEP2023H4, BU 
F20232»C«lftSnfc3TVK**yfflU F P C 20233-x 
OHTyF^ilU F P C20233(CiM^ o F P C 20233 

U S C 2 0 2 2tc?|#{fi"r 0 COBS, x^Xfi^ 

1 D v '>-y>X I D > V— X I D, fXfi'W^a 
yiDti, WI*offlS*<^&<fc3fc:P E P 2023 nc<t 

[0 0 8 9] f-fX^7U>fi}-7-b'V FlOtt, * 

ft. T^lsiM, jE«SKT»Xt— ^X^U-ACO^t 
^'^SS-r^o r^^Tl/Wty h 1 0^6 I C 2 

023 *"t?<Diiii-e«, 7b»^7?4 o i *pyu—i± 
^o-F4 o zft^stcjstssisn**^, 

AflDlSiJS^RtenSo I C 2 0 2 3<DF P C 20233 

^^SfibTBU F20232«C«ttL, ^ttTiE^tCteiM 
A^t)o/c^^^\ X^-^X-7b-A^:S:fib. PT 
P20231*CfiJOa#*AHtT-r--*<DKiS6^T**^"r 
So PT P2023K4, *J0i&**S^*fc. SPC20230 

^J£iEJjL, *X h 3 oifcn^-^m^m^'t^^o 

iH^So. S P C 2023014 #X h 3 0 fC^—^^riMfFI 
L. iE#»7*«BS-r«i:PTP2023ilc*rLiiJ93i* 

[0 0 9 0] CCTi4, 7 7^^f-t^M)(W^X F 
I /F<Dmt LT/^Wl/S C S I*^Lfcrt<, ftfib-Y 
y?7x-X, tf»J*tf, ^^V7b-^WXM/ 
F T^fe % KSCON^tC » Lt t W*k: Mffl-T £ £ ^ WRTft 
T'SSo fVX^7 WX^y^ 0<D*X h I/F/ 
-F2 0 3 tLt, WAtf, 77^f/^t*;K 
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^^fyyu-^i:, ^-y^^nvtfrL — ^ N *7— ^x 
■f — > a > " T j" © i ^ to 6 * — 7 s > > x t- A c?3 Pi # ^ ru -ft 

><X^7U^1/Fi:im mi fr£&3£lftflgffi£ 

^ I /FfcttLTfcffiR© I /F*ttffl-T*Ci:^nIjiE 

[0091] msnmiem fvx^r^^ 10 

£o «h "#0", "#1" ^fVX^TW^Xf 
^1C0P 9 1CD I /F 3 Ofi^y-T/^-v^wl/, t>Xh "# 
2" i:-rV^^7U>r^X-rAl©M(i, ^7Wl/SC 
S I (Ultra SCSI) . ^Xh " # 3 " tf-fX^TW 
^Xr-Al^Hti, /^7l/^SCS I (Ultra2 SCSI) T* 

[0 0 9 2] /«9Wl/S C S I OfVX^7L/^X^7 20 

^X^7Wf7"t!7 F " # 2" £: 44 # 3" TM 

feCD^-T^o UfcSJO^TenS L UNB, fVX 30 
^T'UY^y-tr^y h 44 #0" £0 L U^&KfWc^ LUN = 
0, K 2. • • • 6ST<0 7 0TfeS 0 
[0 0 9 3] El 1 9«\ SaSS* 5 <D*^iSa±tC^ 
Jti§BI^)-(!riJt$^c Htt. *X M/F31t^ 
il^- 7F ( L U ) £ 0»(5*S L ^tta^ttW 

[0 0 9 4] ^a^^M 5 0 &*X h I / 

F 3 1 frcB8*r5tS$H3 10 0. SLU1 1 Olclllf 51f 
IB 11000, ^X^TU-r-9-r-tr^ h 1 0 £ L U 1 10 

omwmmm^n^o *x n/F3i Kuu-rsti'/ffi 40 

tlTB, 1/F81*, I/FiilHft. X-r-^X^rY 

iti^o i.u 1 1 otciwr*«*4:brtt, ftiwitr-fe 

7fS§, LUN, §fi\ RAI DU^;k X-r— ^ 

x. fi^snso es#fr4c<o«s*#fig-r 

[0 0 9 5] iiMfMii5 0±T'> WM/F 
i: L UCDffllcmfrftZ^ZtfiLte. &*X H/F31* 
*S£LT7'**X^ftg£:L U 1 1 O^lTt^o *X 

h i /F^e>^t?3'ji^nr»v^t^L u i 1 oicwlt, so 
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^-<0*X h I /Fi<CfMtr3*X F 3 0frbB7^-bX 

-etftt^o *xf3oic±ot\ ad^-^jBSC^Ra 
fct\ vx^A^,i5^t-§r^i!^7b\ conMifiifcJl!^ 

[IKC^f, (MAfcf* LU 44 #0" 14, ^XH/F 
44 # 0" Ss^tf "# 1 " ^^T^-feXPl^TS^A^ * 
XM/F "# 2" . 44 # 3" frbB7*-bXttft 
L U * 4 # 4" (4, *X F I / F 44 # 2" frt><DZ*T 

[0 0 9 6] C^cfc^^T<>^X^ij•lJIS^^fi l !^i>/cA67 , 
* *XIMHtff«tt* -rV X ^ 7* U-Y ^rMMffllf 
&7 0^6fVX^7l/^X^7f2 OlCttLTJMfSS 
tlSo fVX^TU'l'X-f^vf 2 0iCiM5tlfcT^-feX 
SJffiWStt. h I/F/-F2 0 3 tcsaft stu 

&*X h I /F/- F203<QDCT2027 t<Cg£i£ 

n^>o >txh(a^ Tz^xmmztxtcLuicitfir 

XM/1V-F2 0 3B, UCT 2 0 2 7 O^S^rfT 

— £rjg-Tc£:T\ ^-OLim. *X F ft^tiiBiKSSnft 
<%3 0 I. U/lffii^M^^V F L/Tti, SCS 
I 7°n hn;l/£Dif'8'v Test Unit Ready HY> F^. Inq 
uiry3WK*^— (SiCfflV^SnSo CO&S&UC. U 

[0 0 9 7] *»it1^tXF I/F31 ©tCT^ 

■bx*M**HtTv^5*^ cn^tta-rscii-r, *x 

h 3 0S^T^-trXSiJ|5g«r*Ht5c <h t>&miz$ZMX'% 
&o £tz, *X H/F3K *X h 3 0, fcSl^ii. 
T F UX^IIU^t^ LT, U - K<D*15L 7^hW 

i ^ , n w F ^a^tj IS i; T ^ -tr X »JIB* AHJ S 

h I/FS-if. *Xh I D, WRRnw 

[0 0 9 8] ^CK, ff/c^^VX^TU^^r-tr^y h 1 

1 o*«T»ifc:ifl4p-r*«^ fvx?7w 

X-T ^y^-2 0a)$"v>n^fVX^7W I/F/-F 

2 0 2tc}IA0'r§T : VX^7'U^^r"tr'y h 1 0*Sfia 

»««J«BllB5 0K:aSSnT^* r»»f«c!»*SWJ 
t^V5 0 0l?:lfT1-|)o C©»ft5KJ6SLT\ *IS 
^fVX^7l/-Y^7't:7 F?:K-r^Hffii±^S^ 
(H^-T) c c^fVX^7^t7-t7h<D 
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*'Jit&-t&a £ CT*,SJi£?tl4Ji'il Uct± L R 
A I DU^;bW*5o fcWtT, [ill 9 OA&PI!«*SWric 
HOHiffifcffl 5 » * 3 £ , rr^-rV 7>7W*7t v 
htLUAinio «B, *XH/F3 1«(i:»f8 
7*HrXSJB*RJ£U rgg^ftffj t^VS 0 0 2% 
ffTt^^:, f-f^7U^yf2 0tcSU 7'^ 
**IMffiflMH, fccfctfxVx^TU^r^y K LU 

[0 0 9 9] gfVX^TWW'y h 1 OtaU 1 
l^Tt«tfBI*^IRTfTtotl*o RftijStt. fit 

^*ffj»»ffi*Hiffi±T»SiLr r»j|»j ^ysoo 

[0 10 0] ffi6*lfiJ rVX^TWX 20 

^y^-2 0l«:J:S5^-U V^O'&Iltco^T. 

2^)fVX^/7 F0 2O0?fciL U 

[0101] ^siajBiBfc^ts^x^rAiDWriettiai 

X^7UY^7 h 44 # 0" £: 44 # 1 " &£<ffl—<D 30 
L U*M*4iu*T:fctK c^2O0fVX^7l/^^7 
-fe*y h#*X h 3 0fr5tt 1 OOrVX^7U^tlt 

>7^*^7h^7©#f* "#0 1" kPf-Ko 
Jt.^fVX^71/W-t7h(DLU 44 #0" £L 
U 44 # 1" Kct-pT55— UV^r^JgdcStl, co 
LUC^7«:SS±, LU "#0 1 M Wo DCT2 
0 2 7 0*X h L U^fiSc-T 1 — :/;l/Z0271±T L U # 0 1 
fcSS^Sfc&OWffitt* CLU Classic fa iriuredj ft 
f&/i-£*U LU Info.il LT, L U # 0 t L U # 1 tCfflf 40 

[0 10 2] **j»flgffik:fett**8»Oi!if^U:. mi* 

Fy-F2 0 3OlfW«Cl^t§o 82 0tt, * 

$/— *>X*jS**SBL 12 K 2 214, 7>fHff 
B$tcfelJS*^h I/F/-F2 0 3tCj;*jfiS!©»tft 
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[0 1 0 3] 5>f HWWN «h3 0«Rl/:7^ 
(FCP.CMD) 14, I C 2 0 2 3IC<fc 
SSfI£ft« (12 0^9 (a) :X^^7 C 2100 
Do I C 2 0 2 3lC«fcD§{.i2ftfc5-1' hawK? 

AM\ SB 1 'JUflUBfllTilttBII L/c »J - KOMWcfctf 
3 Xr-y 7*20002 20005 ZffltiUC JELSS n§ (Xf7 7° 
21002 - 21005) o 

[0104] S C 2 0 2 2 (4, SP2021 #{£0 T D 
CT 2 0 2 7^M'U ^7-lt?n/cfVX^7U^ 
tf-:/-fey h "# 0 1" OL U "# 0 1" 'XO^-Y VT 5 
HrXB^feSCfc^Elfrr* (X-r>y 7°21006) o S 
C 2 0 2 2(4, F B 2 0 2 5±&C, SffiLfcnW K"7 

u-^oaga^ffja-r* (x^^7°2ioo7) 0 SC20 

2 2 (4. D C T 2 0 2 7 tCiS>i£ Stlt^SliWtilSlC M 

■^^T37yF7l/-^^MIfi/\ LU 44 #o" 4: 
LU "#1" OM^O&i^Onvy 
*TS (XT' -y 721008) c ££T\ LU 44 #0" %±L 
U, LU "# 1 " fttfc L Ufcn¥U\ 3vyF7U-iAt: 
t*nfn±37yF7U-^ ffinwF7U-A^ 
«¥-Po fit, M#giJ/?tCE T 2 0 2 6&CX^X^x V 
S>«*H*4ttHU f^X^7UW-tr7h 44 #0" £ 
cttf-r^X^Tb^lfr-fey b '*# 1" KttLmfiLfc 
37yF7l/-^Rt§ 0112 00*01 (bo) 
(hi) : X7^y7°21009) 0 

[0 1 0 5] §fVX^7WW7 F "#0" , 

44 # 1" t4. 37>F7U- i.ssiL, tn^ttj&ft 

tC-r-^te^M^T^U— A (FCP_XFER_RDY) 
X^7WX^f7f2 0 (0 2 0 0*91 (c 

0) (c 1) ) o f^^7WX^7f2 0t1±, * 

x h i / f y- f 2 0 3 si ^m&micistt% U - 
F®(^xf *y 7*200 11 200 1 3 1 « o jaa ic & o 

jntt /tT-- ^lEJM^tiii^T 7 2*£4S?l!ir « (X 

T^y7°21011 - 21013) o 

[0 1 0 6] ^X^7WW7 Ffre>Of-J f 
$53* 7% 7 ( X f7 7 P 2 1 0 1 

4) , S C 2 0 2 2(4, *-r— ^ISaSVfli^^U— 
tcW-r*SSS*'HflfiL (X7^y7 o 21015) , I C 2 0 2 

3i f c£vmwi'&<D7i<-i±%:*xh3oi ( £mm?% cm 

2 00*01 (d) : Xf-y 7*21015) o 

[0 10 7] *XF3 0tt, x-^easipfli^T^u— 

— A (FCPJATA) ^r-rVX^ZL-fX-f ^y^2 OtciMfi 
(13 2 0 0*01 (e) ) o *Xh3 0/i>6Of-* 
7l/-Att, I C 2 0 2 3*C£ OSff StlSt (X^«y 
7°2103l) , 'J - F37> F7 1/- h 377 F 
etiolate. FB 2 0 2 5(Ctg«n, C R 
71/-A / \7^»fifWTbn5 (X-7-^y7°2103 
2, 21033) o 7U-L^7W«fgSCS^t, ET 
2 0 2 6tfSP 2 0 2 1 tCctO^^n. X^X^-i> 
^ti7**«fflWS*n* (Xir>y 7°21034) 0 
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[0 10 8] S C 2 0 2 Zit, 5^ h37>K7U-i* 
Ofc*i:RM«»c«H*ft*b (X-r*y72l035) , 

0" tc. ffi/j'^xVX^TU-rity-tr^ h 44 # 1 " l*JG0 
!.U "#r KfattTaSfflM"* (112 0©fc9l (f 0) 
( f 1 ) : XT^y 721037) c 

[0 1 0 9] fVX^7U^t7*-b7 h 44 # 0" . 44 # 
1" It, 7^— £7 U- U fVX^az 

(FCP.RSP) 5:fVXi771/^X>f7f 2 OtCiJSfi-r 10 

-So 

[01 10] S C 2 0 2 2 fVX^7l/-f^7 
h "# 0" . "# 1 " ftlfWbXr-^X7l/-A 

^s-fs-r^^:. we > ^xf-?x7u-^6tti^ 

7^*WLT7U-A / Ny^BSL, E T 2 0 2 6fr 
5x^X^x>^*««!8?#'$''« (X7^y7°2104K 210 
42) o 

[0111] f^X^7W^7 h 44 # 0" . 44 # 
1" Wf^b(7)Xf-^X7l/-i,/)W^ (X-r^y 
721043) , X-r-*Xft^IE«»TT**aci:*SIKO 20 
L U 4, # 0" fr5<D£X^— £X7U— ^tCitT 
(X-r«y 721044) , »f-^X7b- 
Afi'lfe-r^ (Xf7 721045) o ^LT, I C 2 0 2 3 

MciMfrrS (lil2 0CO^Rl (h) :X-r^7°2104 
6) o »SP 2 0 2 ET 2 0 2 6(?)x^Xf- 

xV^«*H*^£-r* Wf7 721047) o 

[0112] u±T^^-v>?mmc&ifz>'7'<bm 
s#»T-r*o 5 7-u>ysnftLu "#oi" &c*t 

fctK&tK 2^)fVX^7^^7 — F3 
v > K*5gfT-r £ * < > if "6 6 *t L T 3 
vyH7b-i,^}Tttitt^o fcfcAtf, ^c±L 
U(cWLT3WK7^-A^{ : fLttJ:i/* 

[0 113] ±^Lfcfflat?t±, Xf* 7°21014. Rt>' 
X7^7°2l043T'2^cD7 2 VX^7'U7^;/-fe-y h "# 40 
0" , "# 1" ©IS?*****, ffil«OMIW*4:-aT»fJ! 

[0 114] C^Mfc^ifc^Sfc*!), rVX^TW 
X^-y^Rcfct^T, t^VX^T W+l-^-tr-y b<DJt*g$r 
tz-f\,C^K<r>mVKmk,1t *) , f-fX>7 Ui'-y-y-tr -y 
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[01 1 5] f^ii^EnT^$n?.7u-^->-y>xi? 

X^y^lOlGTlTbn&^X h'\©-7 f — 
(i5t7 7 U-AOjgfitf, Xf- -y y21009<?>j!!lli©^, 
f^771/'f -t^-fey h 1 0fr£>©^'-2$s&^#t5r 
77l'-A£:«ffc-ffc»56£ftSo CKDiia-, *XKC 

mm a n § f-- * $s asmmissT 7 u- a a . t-v x * t 

WX^'y^-2 0<DS C 2 0 2 2 fc J; 'D &fi£ £ tl 3 (fig 
S8fc01 (d' ) ) o 
[0 116] *Xh3 0A^li, (e' ) 

7-y^2 0tCteiMSnS o f-fXl'7W^'yf 2 0 
Tii, COr-?7l/-Atf-lF R 2 0 2 SlO&MZ 
tl&o SC 2 0 2 2H fVX^7l/^^7-lz7H0 

-r- * $£^5{jffl5£7 7 \s—UtFxk 6*lT * fc-rV X ^ 7 
U-T+l-7-tr-y h 1 OtCfcfU F B 2 0 2 5 telSJf^tlfc 
f-^71/-A§e2t§ .(IW«$5B1 (f0' ) t (f 

I' ) ) o 

[0 1 17] rVX^7UX^7f 2 0*>£*X h 3 
0^©*S7$S{'r{±, TSJTjOt-VX^T Wt7^rA 

i o (fi&s^ep (go' ) , (go' )) # 

SofcB^T-fcC&^ns (fig^F-n (h' ) ) o c© 
<fc 3 ftflaSfC «fc 0 , HI 2 0 tC^$n*B#MT a CQ^/clt 

jas«fffl*jawr sea A^fgT**, 

[0 1 18] rVX^7WXYyf 2 0>fVX^7 

[0119] s*Eff't'«>iflffl**7-c vmwnm-t. x^- 

f-fXJ'71/'fX'f7f 2 0«, CCD'f : VX^TU-f'-9- 
7-fe-yhlO (tKIJLU) lzWt%T?-<zX%n± 
^-©c t«r^-rw$s%D C T 2 0 2 7tcgiS-TSo 

g;/c, f^X^7H'X4'7f2 0t±, MP 2 0 0, il 
ffn>hn-5 2 0 4^14LT, fi'Xi'^Xfi,! 

[0 1 2 0] f-fXi">XrAffis!i?S7 0t±, ^ Oiffi 

^(D'ik. fVX^7WX-<7f 2 0l±, jE^t-VX 
^Tlx7->t7-tr-y h^fflt/^TjllS^»rc-r^ 0 *Xh3 
0«, x-7-^^LfcCfc^rgg^-r5ili«^:<, JQ 

[0 12 1] *^fl6J^gRtc J; ntf . 2feOf^y7U 
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^X^TU^I/F y- K©WP»«Ftt*±W p * ^ £#T? 

X x Witt* fi± S«Cfc^T-*4o 

[0 12 2] [ffi 7 MBflgft] 3fe«±«fVX 

X^'U^X-try hOX;l/-X*$/£^S#ffifc:o^ 
D> fVX^7b>TW7 h W^-tX«M? 10 

So #:JUfiSfB«-ett, f>x^7i/^x^7ftaDc 

[0 1 2 33 B2 3I4, ^ISifiJgftltCfctJ-ST-VX^T 

-TltX-fey b 1 Kl/XSHtt, XhWWX 

St'7h7-Ykfyy?nT^«o *X hfr^lftf^X 
^7U-fyXfA 1 KUXSffltt, Xh7^7°^ 
XSSlc. f^X*7Wt7*7 h "# 0" > "# 20 

1 " , "# 2" . "# 3" tC^ftSftT^So Xh7^ 
X*M X S Xtefi S fr\ £$D/hS<4^ 

X h^X+^XSfrvh£-T^S£. T^-fc 
Xt^tr-^«©Xh7^7tIt§Xh7^7° 

% x h 5 -r xs sr **ss*-r s ss^ww^-r s <dvve 

[0 12 4] tTF> *HSS^fcfett«*^h I/fV 30 
-K2 0 3<D3iMtteo^T\ El 2 4tC7f^3ttf^yn-^- 

MWtSRBtSo **fiSJBJBT*i, D c T 2 o 

2 7<D*X h L UMf- X;l/20271±T% Xh^^b° 
V y?nfc*X h L UtCBB-TSfliaOCLU ClasstCte rs 
tripedj fr\ CLU Stripe S izetCfcfcX h ^-f X+MX 

[0 12 5] *Xh3 0tf37> F7l/-i,^Tt§ 
fVX^7WX^7f2 014, *XH/F/- 
F2 0 3OI C2 0 2 aT'CnSSfi-j-r* (Xf77 e Z 40 
2001). SC 2 0 2 2kL IC 2 0 2 3^e>C^3 
■7>K7I/-^§TOD, SP 2 0 21«^TDC 
T2 0 2 7*«*U X F ^ tf >XT S;&gtf&S C 
fc*E«-T« (Xf77 P 2 2 0 0 5) o 

[0 12 6] ^tC, SC 2 0 2 2«\ S P 2 0 2 1 
(3DCT 2 0 2 7«^U Xh7^7°^X'S^ 
««flWR^6, 7^-bXOWfti:ft5T^$tfIt4X 
b7-fyoxh7>rXSt«:*46, c<QXb^7W 
0)fVX^7W^7-t7 F 1 oictawsftT^aa^s 

AL--TS (Xx«yX22006) o C<ORL XF^-fXSfc^f so 
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f^t^o X h^^X^fc^^feL^l^l^ SP2 
0 2 1 eOIWttJftfcfflrJ*. S C 2 0 2 2 (i37>F7 
^tcJ*Uffi«*SSL (XxyX22007) , X^Xf 
x V^f/ffli* E T 2 0 2 6 tCtSWf S (Xf7 X2200 

8) o wB«i, ai*«jBi«fcra«»«ia^fftotiSo 

[0 1 2 7] Xh9-<X£fcifrt<»£Lfc»^ SP2 
0 2 1 fcL 2 0^3VyF7b-^MtSo £<D$L 

*ffl«i^-«cfcT*fTto*iSo Mnn7yF7U-A 

je-TSo S6*ffiJB»fcH«. SC 2 0 2 2WVF 
7b-/,^»fttU:^ ««e0ffiHi-rsc4:feBj 
flEt?*S*^ C Ct'tt, S P 2 0 2 1 tc± o«r»WcfPrit 
Sft4fe©fctSo SC 2 0 2 2tt, 20(?3nv>Fy 

•b^M o^ft-f s Q 

[0 12 8] ccom. gl»li:^cf-^^ 

<D*X F 3 0 t 2^fVX^7W^7-t7 F 1 0^1 

ZfrOx^X^Tl^lfX-by F 1 Ofr^K^SnSx 

~?7U-AH t^T*Xh 3 oteteES-r 

So C 2 0 2 2tt, SfVX?71/W-i!7 

202 etceis^nfcx^x^x^^Wffitc^v ia^j 

3 0tc3Mff*TSo 

[0 12 9] b9EM<Dt&&lt, 37yF7l/-A<D 
§f^X^7W7^7h l OJcfiaS'TSo x 

-?7u- Aeojiiro^aiiiwtt, fcsiHixVx^ 

7WW7 FtfT'I? F*X*— (Out of Orde 

[0 13 0] gf£lc, t^T©f- *IE2i*<5*TU x 
^X^7 r U^X-t / «y^2 0tf2OOXf-?X7U- 

^fVx^7W^7 F l o^ssfi-rsi:. SP 

2 0 2 1 GfcS^fiS C 2 0 2 2) H\ *X F 3 O'MD 
Xr-^X7l/-^MU CM I C 2 0 2 3lC± 
D*Xh3 (HCilSf,3f So 

[0131] ^mmmmicxta^ r^x**gswx 

Y — Zfohl LTX;l/-7 P 7 F#fa±£i±S C h^T^S 
fcfcfeJC. T^^XuVx>vt¥^/WtcfgM^^SC 
i:^pJ^T$>So 

[0 13 2] [85 8 #|jWJ&!K] 2^fVX^7 
U-l'i/Xfi, (S/ctix^X^TU^^X-tr^ h) M(c 
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[0 13 3] S6ftWl^»llfc^7-'Jy^ 

U>T I /F 2 Ki77^/^t*WJ:^o LfrU U 10 

7 -try h) AM 0 km*a*SiflW*t,Sii v {*nSJli 
-g\ L *7 r >T / ^ ^ <fc 0 "7 U— 2***kjJS 

C 4: ti^ffl±^oIftlT3o 0 , ATM (Asynchronous Tra 
nsfer Mode) «t «ffijg£t$II]tt J Pffi£aff «*VH^ 

[0 l 3 4] H2 5I4, *»ltC^^§fVfX^ 20 
•J ^Xir^O^tfijT&So 
[0 13 5] 8 UWhA, 8 2(WhBt*D, 

8 1, fccfctf-tfM' h B 8 2 ^tlftlrVX^K 
yXfil*tt5o CCm ^hA8 1 tfilfirffi 
ffl?tiS«ffl^hT'«^ h B 8 2ti^ h A 8 

1 tfift SF9¥T ^ ^yLftttcttfflsnsy^-hf^ 

[0 1 3 6] h A 8 1 «fVX^7WyXfi. 1 so 
0<D-rVX^7' Wt^-fey h "# 0" , "#1" cort 
Stt, it-f h B 8 2^fVX^7^S/XfA 1 OO'J 
^-hntf-fflfVX^7l/^^"fe7 h "# 0" . 

"# 1" tc^lf— SnSo fVX^7U^X^7f-2 0 

«a TM*mv^Td>*iHitt9«c»ttsnT^So coy 

-F^ATM/»F2 0 5 i:Wo ATM/-F205 
tt, HSK/WWh I/F/-F^»M^n, 
I C 2 0 2 3#A TM-7r>T/^^*7l/OSS6*fT 
3o COgfliHU SD 4 3tt«SJB!lBKU3tJ « S C S 1-77 40 

[0 13 7] ^HjSfiJBffitCJSttSU*— hnfcf— <0*tt*I 
tt, S 6 SMffilcfettS 5 7 - 'J > ^ffilfcSftlt 

[0 1 3 8] *X h 3 OA^-Y h37>F7U-i4J8 
fifTS^ ^FA8 1 ©f^X^W^XfA 1 0 

H0tc:'K3S-rSo M07U-AB, ATM/-F20 so 



teSfliStU 4J5KISI«9«:^UT'9--r F B 8 2tC)M£>n 

S o 

[ 0 1 3 y ] h B 8 2 Ttis -rV X*7' U-rx-f -y 
filOCATM/- K2 0 StfCOO/Wy hSrSUf 
So A TM7- K 2 0 5© I C 2 0 2 3 (J« A TMA^r 
•y bfr6Xr^^^;b7U-A£TOi!U S C 2 0 
2 2tC$E3£-r-5o SC 2 0 2 2IJ, *7,h3 0frb7-f 

ilt§ 0 Uflk f-?li»i^77U-i^ 7-"- 2 7 
\y—L^ Xf- ^X7U-^£D-r^TtCfc(/>T, ATM 
7-K2 0 5{Cfcl/>T7ri'/^-V^7l'-A TMgM 
ffv\ |nJ«W7U-/,fe}M5Qf l l!^-iiffi-rsC tick 
'Jt-ha # So 

[0 14 0] *Xh3 Otf'J — 

hfiD-rV X^T'l^tfT'-try h 1 OCWLTO^nw 

•y h 1 OA^WAf-^S'J-Kt^o COt^CDWlit 

[0 14 1] **flti^fc«ttitf, a-ff-^?:U7 

fVX?7 l^T ->X 7- 2»M«(cft T 5 W'l±*{#x. 5 c t 

[0142] [gig^ffi^jlEt] ^tc -£r«f-~-rx^7 
u-r-y-7*-tr>y h i o tca^^nss^© l u co^a-tco 

W±> j^ScD^XxAiicoS^tt^ffiif-rsfcfeti:, a 

mxv s.—.LcDy-'f xvmKBtf 2 g Btcis^^nrt/^ 

So C«)J;3%f'fX^7l/'f->XfAW-7V->X 
fU'fe 4±J 1 1 f 5 L U ai6ffl.$ 0 a - X"© 

tfSCSo ?CT\ r^^7WX-fyf2 0O«ig 

T D<07v#^i&Ea" L U^HitSil il^^X-So *H 

fiiSJKffiT-ti. «^LU Off^T-V X ^ T U-i' X-C -y 
2 0T*ffit5o 

[0 1 4 3] *^M®rgfCfcttS LUCl^ti, ifi 1 ife 
MBE^JCfe^S^W-rVX^rU'T-y-^-tr-y h 1 0 lc 
J:*»&L Ucoft^^lHI-T'^So PI— ©f* 

^X^7-L-Y^-7"-b-y 1- 1 OrtOffiSL UK«k*«E^T 
^SClfcfcttT'feSo f-rX^7W->XfAi:Lt<D 

[0 14 4] C(DJ;3tC> R— cDxVX^Tl^+fX'-fe 
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[0145] im\ ommmmi fvx^rw 

X-Y-yf-l Otc^^X^/^O.iS/iiyfSHCO^T, 19 2 
[0 1 4 6] 1112 BtC^SftfcW-Jia^X-rAtCfitJ* 

/F21 *ffl^Tf^XJ7UWt7 M 0^:7^ 

-CX^TUW-byh, fVxn'WX^7f2 0 10 
<D*X h I/F/-H2 0 3eifff^X*7l/^ I / 

Fy-K2 0 2tt, cciT'^WBinc^ftftL^sn 

[0 14 7] f^^7UW^7 HOtt, 13 2 i: 
l^«t<0«jS**rU 2^)fVX^7Kl/F3>h 
D-^ttftlftl 1 ^fVX^7WX^7f 2 OtC 

tDDCT 2 2 7tCti. fVX?7W I /F 2 1 £>5ft 

L fzm&lc t T ^ -bX * «t 3 fcRfrt 5 20 

-r 1 /f "# 0" ©Sflf/w*f-f7*7u>r 1 /f 

"# 1" > fVX^7U^I/F ,4 # 1" OSf^U?: 
f^X?7W I /F "# 0" £ LTISaE: LT4o < 0 |q| 

[0 14 8] El 2 6 fcz^* £ 5 fVX^7b 

-Y-tfr-b-y h 1 <D±{iLT#-/2 "# 1 M KSHtt-ra^ 
X^7WI/F21 tfttSL, IW*tfSg£LfcJ:<Effi 30 

A^Lfcf-fX^7U^ I / F 2 1 fcflJMJLT^S* 
M tt, fVX^7W^7 h 1 0C7^ 
^?%<^o fVX^7WX^7f 2 0tl -r 

>rx{'7W f7-b^ h 1 0 tcom<Dyu— AteiM^os 

[0 14 9] /WOBSimtSi:. S P 2 0 2 1 
14, OCT 2 0 2 7^7^ X^TU-l' I / F "# 1 " 

Wtf*<JB*Lfcc4:*BE»U ^X^LTfVx^ 40 
7WI/F "#o" *ffifflt5ili:*3B[at«o W 
15$, *X h I / F 7 — K 2 0 3 <D S C 2 0 2 2 14, *X 
h "# 1" fr6©7U-i*f-fX*7U^ I /F "# 
0" tcSSt§fVX^7^ I/F/-K2 0 2tc$s 

[0 15 0] fVX^7U^t7-tr«y h 1 0<D±teT^ 
7°^ 1 0 1 J4, *X h "# 1 " fr603^yK*?lt« 
^T«t5 0 f^X^7WX^7f 2 Ott. 

r^X^7 i/Xx^«Jl«Sa!#S 7 0 tB^OiliS 
^riffiSJU f>f X^71/^^Xf«ffi.f-S7 OtC so 



[0 15 1] **flfiJ&*fcJ:fttf, L 
felSOSS^^^OfflOSA*^ *X Mi'JKifSM^S 
cfctt<fr3ci:#"e** *x hflliJ^x^WS^^^ 

[0 15 2] W±BlWLfc**iM5«T«:. IBtt^fV 

yXr^icov^till/co LfrU *f8Wtt, cntc 
ffiffiSn-5t><OT*4*<, IBIt^T-VTiiLT-rVX^ 
«BHcHS-$\ #tVX*S£BL f-/gl, DVDS 

[015:-!] 

[0 1] H 1 ^)SS©Ss©3>'t 0 i-^>'X^Acr)^fi)cll 
[12] HS»l«rVX^7Wt7-b7KDl 

[13] is 1 mm&m<D f-v x ^ t u-r x-r -y is 

[04] Iff 1 JlfitlJg^CtS^ST-VX^T'WX^-y^ 

© ^ p x -v ?-<Dmi&.m t to % o 

[0 5] mi ^fl6^fts^fctt§T ; VX^T^-rx^-y^ 
OWb I /F/- HO#liS0Tfe§o 
[0 6] ->X-r/»*lfi)t-r- 7;l/OilSIT$5 0 
[07] ■y-7-tevbffil$.7—-7>l'<Dffi®.mT*&Z>o 
[0 8 ] 7T^/^t*;M)7 U-i*©ttM0T£5o 
[0 9] 77-f/ , !ftW07 U— A'N-y ^©«IT* 

[010] 77l'^f- + ^Vc071^-A^D-F©l 

[011] *X hfr£©y— KWfl*B#fc 7 r-f 
0T'&5„ 

[0 12] *XfLU, Sf^X^7WW7 hco 

lu, wsTVxya^7 howjasuufc*^-*" tt&H 

[HI 3] 9>T hffi3fl#<0*Xh I /F/- KKUSttS 

[mi 4] h^itfeSo 

[HI 5] SS«fVX^7WX^7f?^7X^ 
gL/:f^X^7^yXfi,^MiTS8o 
[HI 6] ^2^ffiJf^^4ottSri>t: 0 ^-^^XT'^ 

m \ 7] ^4^fl5fgtCt5tj-S-T-VX^Tb^X^^ 
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=f-<D-4 > Z 7 x - X 3 y V a — 5 <D$tfig0 T'£ 3 0 
[018] &5^ffi^{fifc48tt4:3Vfcfa — *'>X-rA 

[0 19] iSiaiS^^liiMo^^J^^-riOSirttiliM® 
T*&3o 

[0 2 0] %6nmBmicist l fz-7\s-L>i/- j r>x& 

[02 1] m6*fl6JK«05 7-'J V^7^ h^IBfO 

■So 10 

[022] ^6 nfitnB!»©5 7-u bmm<o 

So 

[023] W,l '0ktf®&mz*5lf%*X V L U fc#f^ X 
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